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Foreword 


This  collection  of  technical  reports,  documents,  and  memoranda  deals  with 
estimation  of  the  coherence  function  between  two  wide-sense  stationary  random 
processes.  Topics  covered  include  accuracy  and  stability  of  the  estimate,  in¬ 
cluding  the  effects  of  weighting;  approximations  for  the  statistics  of  the  estimate, 
the  use  of  coherence  in  time-delay  estimation;  interpretation  of  the  Fourier 
transform  of  the  coherence;  generation  of  processes  with  specified  coherence; 
and  alternative  methods  of  estimating  coherence.  Applications  of  coherence 
estimation  are  given;  they  include  systems  identification,  measurement  of  signai- 
to-noise  ratio,  and  determination  of  relative  time  delay.  This  book  furnishes  a 
handy  reference  for  anyone  interested  in  obtaining  high  resolution  and  stable 
coherence  estimates  from  limited  data  records. 

In  addition  to  the  results  presented  here,  other  work  done  by  the  authors  is 
available  in  the  open  literature,  as  listed  below. 
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On  Generating  Processes 
With  Specified  Coherence 


A.  H.  Nuttall 
G.  C.  Carter 


ABSTRACT 


For  purposes  of  investigating  the  bias  of  different  estimators 
of  coherence,  it  is  necessary  to  generate  processes  with 
accurately  specified  known  values  of  coherence.  A  method  of 
minimizing  the  effects  of  unknown  power  levels  on  the 
coherence  of  the  generated  processes  is  presented,  such  that 
desired  values  of  coherence  can  be  very  accurately  realized. 
Comparison  with  the  standard  approach  reveals  a  much 
smaller  error  for  the  new  method. 
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INTRODUCTION 

For  purposes  of  investigating  the  bias  of  different  estimators  of  coherence, 
it  is  necessary  to  generate  processes  with  accurately  specified  known  values 
of  coherence.  This  is  commonly  done  by  adding  together  different  fractions 
of  two  uncorrelated  processes.  However,  if  the  two  uncorrelated  processes 
do  not  have  the  anticipated  spectral  levels  in  the  frequency  regions  of  interest, 
the  resultant  values  of  coherence  will  not  be  the  design  values.  This  occurs, 
for  example,  when  two  different  physical  noise  sources  are  filtered  by  two 
different  filters,  and  the  gains  or  levels  of  the  two  channels  are  not  identical. 
This  situation  can  apparently  be  eliminated  by  using  only  one  physical  noise 
source  and  one  filter,  and  taking  two  sufficiently  disjoint  time  sections  of 
the  output  to  represent  the  two  desired  un correlated  processes.  However,  if 
there  are  line  voltage  fluctuations  or  gain  changes  during  the  time  taken  to 
generate  the  two  time  sections,  the  same  problem  arises.  In  this  memorandum, 
a  method  of  minimizing  the  effects  of  unknown  power  levels  on  the  coherence 
of  the  generated  processes  is  presented,  such  that  desired  values  of  coherence 
can  be  very  accurately  realized. 

PROBLEM  SOLUTION 

The  problem  is  as  follows:  two* stationary  uncorrelated  processes  «n4  jit) 
are  available,  with  power  density  spectra  &w(f)  *nd  frs(f)  ,  respectively. 
The  ratio  R(f),  defined  by 


TO)  -  X’ 


0) 


is  hopefully  unity,  but  its  exact  value  is  not  known.  Two  new  processes 


may  be  a  sufficiently  delayed  version  of  *(H,  as  discussed  in  the  Introduction; 
in  fact,  this  is  recommended  because  of  limitations  in  the  state  of  the  art  in  selecting 
two  different  filters  having  the  same  characteristics. 
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v|fc)**|W  +■  (2) 


are  constructed,  where  filters  aft)  find  Mt)  arm  to  be  chosen  so  that  the 
coherence  of  utt)  and  vft)  is  a  specified  function  of  frequency.  The  following 
analysis  will  allow  for  complex  processes  xft)  and  yd),  and  complex  filters 
aft)  and  hit).  Specialization  to  real  processes  and  filters  is  immediate. 
Equation  (2)  constitutes  linear  operations  only;  non  linear  operations  on  %Q  and 
3  ft)  are  disallowed  because  knowledge  of  the  statistics  of  a  higher  order 
than  the  power  spectra  would  be  required. 

The  correlation  of  aft)  end  vtt)  is  defined  as 


ult)V*ft-T),  P) 

and  the  cross-power  spectrum  is  defined  as 

6r,v(f)  »■  Jdr  W 


Using  (2)  -  (4),  we  find  that  the  auto-  and  cross-power  spectra  of  the 
processes  in  (2)  are 

6*^40%  If), 

fr.(H  *  6„lfl  +  IMBfSjW, 

G.IB*  fraW+lBBI’fr.tB, 

where 

Afr)  *  e*p(-i 2rrfi)  elfc). 


t- 


k 


k. 

4 

► 


k 


X 

k 


(6) 
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arc  the  transfer  functions  of  the  linear  filters. 

The  complex  coherence  between  uHO  omJ  v!0  is  then 

y(ft.  S-ft  .  g*8)»Afr)TO)  f 

[S-.tfiSvW'P  [l+|Afrfltl^*[lW>4|B«|,!r  ’ 

using  (5)  and  (1 ).  For  notatlonal  simplicity,  we  will  suppress  the  f-dependence 
in  (7)  and  write 

v  _  B  /] 


[|4  [R*|6f) 


In  order  to  make  the  complex  coherence  Y  insensitive  to  the  exact  value 
of  R  in  the  neighborhood  of  R*  »>  we  will  force  the  partial  derivatives 
with  respect  to  R,  of  both  the  real  and  imaginary  parts  of  equal  to  zero 
at  K  *  \  .  This  can  be  accomplished  by  setting  «•  0  at  R*  I. 

We  find  from  (8), 

Vt  (i*wV) + |rf)  -  B*fr('4Uf  iBf) + 

>*  *  p 

At  R  *  I,  (9)  becomes 


ill  m  + \*f\  -  lAfjBlVlAr] 


Q+  im  j  [W  wtfj1 


‘■IWMV 
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l 


For  (10)  to  equal  xaro,  if  If  necemory  (but  nor  sufficient)  that 

a^(p)  *- 

Under  this  choice,  (10)  becomes 


Equation  (12)  equals  zero  only  if 

|BMa|  or  |3l  *  l/lAl. 


(ID 


(12) 


(13) 


Combining  (13)  and  (11),  we  find  that  the  two  possible  solutions  are 


B*  A*  or  Bm  */A. 


(14) 


However,  the  solution  Va>A  substituted  in  (8)  yields  lf«  e*f{j«rj(A)3  ,  which 
is  unacceptable,  since  it  always  has  magnitude  unity.  The  other  solution 

B  -  A*  05) 


yields,  upon  substitution  in  (8), 

% .  «r[< •  06) 

This  is  acceptable,  since  values  of  |Y|  between  0  and  1  ore  attainable  through 
choice  of  IAI  .  For  example,  tA|  »  0  yields  |)fl  ■  0  ,  while  |A|»J 

yields  |8|  *  I.  Thus  only  filter  gains  |A|  between  zero  and  unity  are 
necessary  to  realize  prescribed  )Yl  .  The  fitter  phase  arg(A)  is  chosen  to  realize 


4 
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specified  arg  (i)  .  The  relationship  (15)  between  filters  forces  the  impulse 
responses  to  satisfy 


WO*  A* (~t). 


(17) 


Thus  one  filter  must  have  a  time-reversed  impulse  response  of  the  other  filter. 
Physical  realization  of  these  filters  and  processes  will  require  recording  and 
delaying  various  processes. 


We  notice  from  (16)  that  R  has  no  effect  upon  the  phase  of  the  complex 
coherence.  The  phase  of  the  complex  coherence  depends  solely  upon  the  phase 
of  the  filter  A,  and  is  independent  of  relative  spectral  levels. 


For  *  *  I  ,  (16)  yields 


08) 


The  value  Y,  is  the  design  (or  desired)  value  of  coherence.  The  required 
filter  gain  and  phase  are  given  in  terms  of  If,  by 

i-Vh 


IA1 


-YmbT 


)  &  K  ft  1 5  I) 


09) 


«rg(A)  *  Arij(Y,). 
(For  11,1-0,1*1*0  ). 


We  notice  that  since 


Ik 

9A  1 


(20) 


becoyse  the  requirement  df/dK  »  O  at  R*l  causes  the  real  and  imaginary 
parti  of  f  to  have  zoro  slop#  at  R  •  I  .  Thus  tho  mogn  I  hjd* -squared 
coherence  |¥l*  Is  also  Insensitive  to  valuos  of  R  near  R  *  I  .  Tho  magnitude* 
coherence  VYi  **  similarly  insensitive. 

It  should  be  noted  that  even  if  all  the  processes  and  filters  in  (2)  are  red, 
complex  values  of  coherence  are  still  attainable,  because  A  can  be  complex, 
even  when  qttr)  is  real.  For  example,  an  odd  impulse  response  iff)  results 
In  an  Imaginary  coherence. 

SENSITIVITY  ANALYSIS 

For  a  design  value  Yi  of  coherence,  the  required  filter  characteristics 
are  given  by  (19).  When  these  filter  characteristics' are  substituted  in  (16), 
we  find  the  attained  coherence  £  for  arbitrary  R.  For  convenience,  we  first 
define  the  error  in  ft  as  & : 

R*  If  A,  (22) 


Then  there  follows 


i+j-A 


(23) 


For  A  ■  0,  Y|  as  desired.  For  A  f  0,  we  will  investigate  the  dependence 
of  the  mognitude-squared  coherence  ||(*  on  6. 


We  define  the  error 


E » ITI'-KJ1  -  KI'O-ICI1) 


(24) 


upon  usage  of  (23).  The  error  is  zero  for  mognitude-squared  coherences  of  zero 
and  unity.  To  third-order  in  At 
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This  quantity  is  maximum  for  l*,)3  m  \  > 

E»  *(H  *-*>• 

Thus  tha  arror  depends  on  R  mainly  through  the  quadratic  behavior  (R-l  f  for 
R  near  1. 

In  Table  1  are  presented  attained  values  of  I'll*  for  several  desired  values 
\Y,\*>  as  a  function  of  R.  Thus  a  1 /o  error  in  R  causes  an  error  of 
C.3»  lor*  in  the  magnitude-squared  coherence  at  the  value  0.5.  And  a 
5/o  error  causes  an  error  of  I.C  ■  Kf*. 


yielding 


(25) 


(26) 


Table  1 .  Attained  Magnitude-Squared  Coherence 


n 

III* 

H 

|T,|*».4 

IY.I*. .« 

1X1 iVi 

0.95 

.3001381 

.4001579 

.5001644 

*.6001578 

.7001381 

0.99 

.3000053 

.4000061 

.5000063 

1.00 

.3000000 

.4000000 

.5000000 

1.01 

.3000052 

.4000059 

.5000062 

.6000059 

.7000052 

1.05 

.3001250 

.4001428 

.5001488 

.6001428 

.7001249 

For  comparison  purposes,  suppose  filter  B  were  not  used  at  oil  In  the 
construction  of  processes  v$  ip  (2).  By  a  procedure  analogous  to  that 

developed  drove.  It  may  be  shown  that  the  error  in  magnitude -squared  coherence 
is 


e>  KfO-rcfi 


A 

h-ki**  ’ 


<»> 


which  is  linear  in  A)  for  small  A.  To  first-older  In  A,  the  maximum  error  is 


(28) 


Comparison  of  (26)  and  (28)  indicates  that  careful  choice  of  two  filters  yields 
an  error  that  behaves  as  the  square  of  the  error  for  one  filter.  For  a  4  /o  error  in 
relative  power  levels  R,  this  is  two  orders  of  magnitude  improvement. 

SPECIAL  CASE 

In  order  to  accurately  investigate  the  bias  of  coherence  estimators,  it  is  often 
convenient  to  generate  two  processes  with  constant  magnitude -squared  coherence 
for  all  frequencies.  This  is  most  easily  accomplished  by  choosing 

aft)  =  bit)  -  &flt)tGr  reel*  (29) 

in  (2).  The  processes  are  then 

uM*  Pqj 

vft)  ■  Jjtt)  *ff). 

The  transfer  function  of  this  filter  is  A(t)»£;all  Pi  the  gain  G  is  available 
from  (19)  as 

£  .  lrV*~iri£ — ,  o  <w  s  i, 

n, I 

where  is  the  desired  magnitude-coherence.  For  1^1  =  0,  6**0. 


(31) 
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SUMMARY 

A  method  of  minimizing  tho  effects  of  unknown  power  levels  on  the  coherence 
of  generated  processes  has  been  presented.  For  example,  a  1%  variation  In 
power  levels  (.04  dB  fluctuation)  will  affect  the  desired  value  of  magnitude- 
squared  coherence  by  only  six  parts  in  the  sixth  place.  Hence,state  of  the  L 

art  power  supply  fluctuations  can  now  be  tolerated  In  the  generation  of  I 

processes  with  accurately  specified  known  values  of  coherence.  1 


NUSC  Technical  Memorandum  TCI -193-71 

28  September  1971 


Evaluation  of  the  Statistics 
Of  the  Estimate  of 
Magnitude-Squared  Coherence 


G.  C.  Carter 
A.  H.  Nuttall 


ABSTRACT 


Closed  form  expressions  for  the  statistics  of  the  estimate  of 
magnitude-squared  coherence  are  presented.  These  statistics 
include  the  probability  density  function,  the  cumulative 
distribution  function,  the  bias,  and  the  variance.  The  ex¬ 
pressions  presented  are  in  convenient  and  accurate  forms  for 
digital  computer  evaluation;  examples  of  their  computation  are 
included.  Simple  approximations  are  also  given  for  the  bias  and 
variance. 
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INTRODUCTION 


Consider  two  wide -sense  stationary  random  processes  x&)  and  ytt)  with 
oufo-power  spectra  6k,(0  a*U  G,(f)  ,  respectively,  and  cross -power 

spectrum  The  magnitude-squared  coherence  between  the  two  processes 

is  defined  as 

Q  (f)  *  .  1  fit  _ . 


Estimates  of  C(f)  from 
made  according  to 


n  independent  segments  (or  pieces)  of  data  are  frequently 

i£x,ww)r  a. 


where  Xj(f)  SnJ  V4|fi  are  the  Fourier  coefficients  at  frequency  f,  obtained 
from  the  i-th  weighted  segments.  The  problem  we  address  here  is  the  statistics 
of  the  random  variable  £(f). 


STATISTICS  OF  THE  ESTIMATOR 


There  has  been  much  related  past  work  on  statistics  of  the  form  of  (1) 

(Refs.  1-7).  For  Gaussian  zero-mean  processes,  the  probability 

density  function  (PDF)  of*  £  (Refs.  2  and  5)  can  be  manipulated  into  the  form 


fit)  »  !< 


(2) 


This  is  a  convenient  form,  since  the  hypergeometric  function  is  a  (n-l)-st  order 
polynomial,  all  the  terms  of  which  are  positive.  (For  C*  p(£)  *  S(  C-l).) 
The  density  function  can  also  be  written  as 


c< 


1 


The  f -depen dene#  is  suppressed  for  notational 


simplicity. 


1 


wWi  ?*-.(}  »«  a  Legendre  polynomial . 

A 

The  cumulative  distribution  function  (CDF)  of  C  can  also  b«  written  in 
closed  form,  through  proper  identification  of  variables  In  the  work  of  Fisher  (Ref.  1): 

?(*)•  &&£  xf;('K''-"'liCC'). c<  i- 

The  k-th  hypergeometric  function  is  a  k-th  order  polynomial,  all  the  terms 
of  which  are  positive.  The  probability  density  function  and  cumulative  distribution 
function  are  plotted  for  n*  12  in  Figures  la-id,  and  for  n-(4  in  Figures 
le-lh.  The  method  for  determining  confidence  intervals  from  the  cumulative 
distribution  function  is  given  in  the  appendix. 

In  order  to  obtain  the  moments  of  £,  we  rewrite  (2)  as  (Ref.  8,  eq.  9.  131  1) 

c<  '•  (3) 

The  m-th  moment  of  C  is  immediately  available  (Ref.  8,  eq.  7.512  12): 

E[£*}  -  «,«;•>*»,  I,  c),  C<  I.  (4) 

By  proper  identification  of  variables,  this  result  can  be  shown  equal  to  that  of 
Anderson  (Ref.  3).  The  series  (4)  Is  easily  evaluated  with  computer  aid. 

The  first  moment  is  available  from  (4)  by  setting  m*l .  It  can  be  manipulated 
into  the  simpler  (and  rapidly  convergent)  form 

i  +  c«  i. 


By  expanding  in  a  power  series  in  C,  a  simple  approximation  for  the  bias 

is  made  available: 
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Bias  i  ~  C 


(5a) 


-L.  — 2__r  4. 

«  nt-t  ^ 


n-  < 


-C*  +•  2 


n-  \  /*< 

(m- •)(«+aXr’+3)  'w 


(5b) 


(Where  (5b)  goes  negative,  replace  It  by  zero).  At  an  example,  for  n«8,  the 
bias  lies  in  the  range  (0,J25),  and  the  maximum  error  in  (5b)  is  .0027  at  C=.  86. 
Expression  (5b)  is  a  generalization  of  an  empirical  result  of  Benignus  (Ref.  7). 
The  bias  (5a)  is  plotted  in  Figure  2;  no  approximations  are  involved  here. 

The  variance  of  the  estimator  £  is  available  from  (4)  by  expanding  jf\ 
in  a  power  series  in  C: 


Vari£}  *  E{c}“Ea[c] 


(6a) 


2n>-w*-2rt  +  3 
(»*■*•*)  (*+aX*+?> 


(6b) 


I3*r- ISn4- H3nJ» *1  wV I3tn- 1*0  r4l 

l«  ♦  01"  vif  (.«-»-})(  M-  4)  ( "■*  O  J. 

(Where  (6b)  goes  negative,  replace  it  by  zero).  for  n=8,  the  variance  lies  in  the 
range  (0,  .031),  and  the  maximum  error  is  .0067  at  Cs.83.  This  result  is  a 
generalization  of  Jenkins  (Ref.  6).  The  variance  (6a)  is  plotted  in  Figure  3, 
again  without  any  approximations. 
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APPENDIX 

DETERMINATION  OF  CONFIDENCE  INTERVALS  FROM  THE 
CUMULATIVE  DISTRIBUTION  FUNCTION 

A 

Lot  1  be  the  true  value  of  an  unknown  par  am*  tor,  and  let  Y  be  its 
estimate.  $  Is  a  random  variable  (RV)  with  a  known  probability  density 
function  (PDF)  p(?>Y)*  (The  conditioning  on  Y  indicates  that  the 
shape  of  the  PDF  of  $  depends  on  the  exact  (unknown)  value  of  Y.) 

Suppose  we  choose  \(T)  Ay(Y)  such  that 

fv.k(Mt') <  i  i  j1)  •  r  d  ft*) -  -1* (*•*), 

ra  (i<  A,w  ,r) . 

- 

Then  the  probability  that  RV  Y  lies  in  the  range  (At(Y),  Au(Y))  is 

Now  assume  that  At(f)  end  AvCf)  are  mono  topically  increasing  with  Y, 
and  continuous.  Then  there  follows 

-  .1  . 

Therefore  the  confidence  interval  for  Y  is* 

(aJ(^),  Al'  (I))  »  with  confidence  coefficient  .9. 

A 

Given  a  measurement  Y  *  this  interval  can  be  computed  once  the  functions 
A'JC  )  and  Au'()  are  known. 

*Ar\  excellent  discussion  of  confidence  intervals  is  given  in  Ref.  9,  Chapter  34. 
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In  order  to  evaluate  those  functions,  consider  the  plot  of  the  cumulative 
distribution  function 

T(Ai  i)-  Jl4r«>*X 

versus  A,  for  a  particular  value  of  ¥,  as  indicated  in  Fig.  I .  The 
T(Ai») 


Fig.  I.  Cumulative  Distribution  Function 

points  indicated  on  the  abscissa  enable  determination  of  e*4  Av(V)  for  this 
value  of  Y  .  Now  suppose  *«*4  A^>)are  plotted  versus  Y  as  indicated 

in  Fig.  2.  (This  requires  many  plots  like  Fig.  1  for  different  values  of  t.) 


Fig.  2.  Determination  of  Confidence  Interval,  for  .9 
Confidence  Coefficient 

A 

Then  given  a  value  on  the  ordinate  such  as  Y,  the  points  indicated  on  the 
abscissa  of  Fig.  2  are  the  confidence  interval  limits  for  .9  confidence  coefficient. 

The  general  results  of  this  appendix  apply  immediately  to  coherence  estimation 
when  we  identify  Y  as  C,  and  ^  as 
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ABSTRACT 


Given  two  processes,  the  complex  coherence  spectrum  is 
the  complex  cross  spectral  density  function  divided  by  the 
square  root  of  the  product  of  the  two  auto  spectral  density 
functions. 

Estimation  of  coherence  in  light  of  the  fast  Fourier  transform 
(FFT)  is  investigated  for  synthetic  data.  The  procedure  used  is 
to  segment  the  given  finite  time  histories  to  NSEG  segments  of 
size  NNN.  Each  segment  is  multiplied  by  a  weighting  function 
(in  this  case  a  cosine  bell)  prior  to  computation  of  the  FFT. 
Cross  and  auto  spectra  are  then  averaged  over  the  NSEG 
segments  prior  to  forming  the  coherence  ratio. 

Practical  conclusions  drawn  are  that  for  non-flat  auto 
spectrum,  multiplication  by  a  weighting  function  is  necessary, 
that  NSEG  must  be  on  the  order  of  64,  that  NNN  must  be  large 
enough  to  insure  sufficient  spectral  resolution. 
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INTRODUCTION 

The  coherence  function  is  in  some  sense  a  normalized 
complex  cross  spectral  density  function.  Specifically, 
given  two.  processes,  the  coherence  function  is  the  complex 
cross  spectral  density  function  divided  hy  the  square  root 
of  the  product  of  the  auto  spectral  density  functions  of 
the  two  processes. 

The  coherence  function  can  be  used  to  determine  a  mea¬ 
sure  of  statistical  independence  between  two  processes. 

When  two  processes  are  independent,  their  correlation  func¬ 
tion  is  zero.  Hence  the  cross  spectral  density  function 
(numerator  of  the  coherence)  is  zero  and  so  is  the  coherence. 

The  coherence  can  also  be  used  to  determine  a  measure 
of  a  linear  relationship  between  two  processes.  If  the  two 
processes  happen  to  be  the  input  and  the  output  from  a  gen¬ 
eral  system,  the  magnitude  squared  coherence  is  a  measure 
of  the  linearity  of  the  system.  Thus  if  a  good  estimate  of 
coherence  could  be  obtained,  it, would  be  a  useful  statistic 
in  measuring  the  linearity  of  a  system. 

The  estimation  procedure,  like  most  spectrnl  analysis 
computations,  is  rather  straightforward  in  implementing, 
but  often  subtle,  and  indeed  difficult,  in  proper  interpre¬ 
tation.  A  minimum  requirement  for  its  interpretation  is  an 
appreciation  for  spectral  analysis  techniques. 

To  illustrate  some  of  the  problems  and  pitfalls  in  co¬ 
herency  estimation,  the  authors  have  simulated  various  syn¬ 
thetic  signals  and  input/outputs .  The  results  are  most 
illuminating,  and  add  insight  to  coherence  estimation  pro¬ 
cedures  . 

II.  THE  COHERENCE  FUNCTION 
II. A.  Definition 


The  coherence  function  is  in  some  sense  a  normalized 
complex  cross  spectral  density  function.  Oivcn  two  processes 
x(t)  and  y(t)  with  auto  power  spectrnl  density  functions 
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density  function  )  ,  then  the  conplex  coherence  func¬ 

tion  is  defined  ns  in  reference  (s)  by: 


sen 


'N  3.  jo 


end  the  aagnitude  squared  coherence  function  ss 


Eq.  Cl) 


*  ISwff)!1 

-  —  j _ Eq.  (2) 

5x(f  >  3Tj  U) 

II.B.  Squared  Coherence  as  a  Measure 
of  Systen  Linearity 

If  we  consider  the  linear  system  with  input.  x(t),  im¬ 
pulse  response  h(t),  and  output  y(t),  as  follows: 

> 

Fis.  CD 

then  the  output.  y(t),  is  obtained  by  the  convolution 
integral  ^ 

±  f  *(t  -'Od'fc 

The  frequency  domain  equivalent  is  a  multiplication, 
namely, 

Y (f)  -  H(f)Xtt) 

where  the  transformation  from  the  time  domain  to  frequency 
domain  is  via  the  Fourier  integral: 

2(0  =  j"  dt 

-  -  Oc> 
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Proa  reference  (a)  we  know  that 

H(f) r  ") ^ -1  3L  (o  +  °  E<|-  t5) 

^x  co 

and  alao  that 

3L(n= 

that  is, 

11^(0  =  IFXU), 

where  *  indicates  complex  conjugation.  Substituting  for 
H(f),  we  see  that  — rr  ^  ^ 


-*V+;  3.,  <0  * 


that  is. 


H”(0. 

or  conjugating  both  sides,  we  sec  that 

H(0. 

but  “<g  is  real  so  that 

_  Isli”  . 

rtU)  3»;o 

Now  equation  (2)  can  be  rewritten  as 

i>.«)  I*io 
U(Ol  -  — j - - 


1,(01,  <n 


Eq.  (4) 


Eq.  (S) 


Substituting  from  equations  3  and  4,  we  see 
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r.q.  (6) 


Thus  for  the  assumptions  nadc,  namely  that  the  system 
is  linear,  we  have  lyCF)!*-*  /  Tf  \!S(f^|lis  not  equal  to 

1,  then  cither  the  observations  of  x(t)  and  y(t)  have  been 
corrupted  in  some  manner  by  noise  or  our  assumption  was  in 
error  nnd  the  system  is  nonlinear. 


This  could  he  expressed  as  a  theorem:  If  a  system  is 
linear,  then  the  coherence  between  the  input  and  output  is 
equal  to  unity. 

TIT.  TI'F  cnilhltENCI:  ESTIMATOR 

1 1 1 . A.  Definition 


While  several  references  (c.g.,  (a),  (h) ,  (c)  ,  (d)  , 
and  (e))  introduce  the  coherence  function,  only  a  few  (ref¬ 
erences  (h) ,  (c),  (d) ,  (c))  address  its  estimation. 

The  method  implemented  for  obtaining  wood  coherence 
estimation  is  explained  below.  Briefly  it  consists  of  ob¬ 
taining  two  finite  time  series  from  the  random  processes 
being  investigated  and  segmenting  these  time  series  into 
NSEfi  segments. 

The  NSEC  pieces  may  be  cither  ’'overlapped"  or  "disjoint" 
from  other  segments.  Each-  piece  is  comprised  of  NNN  data 
points.  A  weighting  or  windowing  function  is  then  applied 
to  each  piece  and  tiic  fast  Fourier  transform  (FFT)  of  the 
weighted  NNN  point  sequence  is  performed.  The  Fourier  co¬ 
efficients  for  the  p-th  weighted  piece  are  then  used  to  com¬ 
pute  the  two  auto  and  the  co-  and  quad-spectral  estimates 
which  are  then  averaged  over  all  NSF.n  pieces.  The  coherence 
function  is  then  finally  computed  fron  a  ratio  of  the  average 
spectral  estimates.  (Note  for  real  data  NSEO  number  of  FFT's 
must  be  computed  each  of  complex  size  NNN.) 

A 

Specifically,  let  denote  the  estimate  of  the 

power  spectral  density  (PSD)  function  at  the  k-th  freouency, 
fj^,  obtained  from  the  p-th  weighted  segment  of  size  NNN  of 
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the  stationary  random  process  x(t).  Similarly,  let 
be  the  estimate  of  the  PSP  function  of  ^yhe  stationary  random 
process  y(t).  Also,  let  and  denote  re¬ 

spectively  the  real  (co-)  and  imaginary  (quad-)  part  of  the 
estimate  of  the  complex  cross-spectral  density  function  of 
the  two  processes.  The  estimate  of  the  magnitude  squared 
coherence  function  implemented  by  the  authors  is  given  bv: 


H  sr$ 


■  -  -j  i  i  r-  ■» »»  i 

Z 


_  nq.  (7) 


Hl£<k 


where  the  circumflex  denotes  estimate  and  NSEC  is  the  number 
of  weighted  segments  (overlapped  or  disjoint)  over  which  the 
estimates  are  averaged. 


Because  the  squared  coherence  estimator  is  the  ratio  of 
random  variables,  it  is  imperative  that  good  spectral  esti¬ 
mates  of  C(f),  Q(f),  3x  (f)  and  2^  (f)  be  obtained.  Random 
fluctuations  and  bias  of  any  of  the  four  snectral  estimators 
become  significant  in  the  ratio  used  to  estimate  the  coher¬ 
ence  function. 


III.B.  The  Computer  Implementation 


NUSC  FORTRAN  program  designated  S1741  implements  eq .  (7). 
A  capsulised  flowchart  of  the  program's  basic  version  is  pre¬ 
sented  in  Figure  2.  Specific  input  parameters  include:  DT, 
the  basic  increment  in  time  between  samples;  NSF.r.,  the  number 
of  segments  of  data;  and  NNN ,  the  FFT  sire.  Programmable 
options  include  DC  removal,  linear  trend  removal,  different 
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Figure  2.  Summary  Flow  Chart  for  Basic  Version  of 
NUSC  S-1741.  FFT  Spectrum  Analysis  Program 
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weighting  functions,  overlapped  processing,  ICS  plots,  and 
printer  displays. 

The  progran's  nndularized  nature,  together  with  its  all- 
FORTRAN  implementation,  has  made  updates  and  modifications 
straightforward  to  fill  many  Tenter  requirements.  The  fast 
Fourier  transform  (FFT)  was  coded  hy  R.  S.  Singleton  (ref¬ 
erence  (1)).  The  cosine  weighting  function  was  coded  hy 
A.  II.  Nuttall  of  NUST. 

III.C.  Choice  of  Program  Parameters  and  Options 
III.C.l.  Windowing  the  Data  Segments 

The  first  program  option  is  the  application  of  a  window 
or  weighting  function.  The  ideal  FFT  resolution,  £f,  speci¬ 
fied  hy  1/(DT*NNM)  cannot  be  achieved  without  a  phenomenon 
known  as  leakage  taking  place  (reference  (f)).  This  is  due 
to  the  non-idea^  bandpass  characteristics  of  the  FFT's  when 
considered  as  a  bank  of  filters.  When  an  NNN  point  sequence 
is  multiplied  by  a  rectangular  window  (no  weighting),  the 
transfer  function  for  each  FFT  filter  is  sin(x)/x.  Therefore, 
each  FFT  filter  centered  at  a  specific  frequency  sees  energy 
not  only  from  the  band  about  that  frequency  but  also  from  fre¬ 
quency  hands  not  desired. 

A 

A  This  leakage  results  in  biased  estimators  ‘Such'S 

y  «v».4 

This  bias  becomes  a  critical  factor  in  coherence  estimation 
because  it  is  then  a  ratio  of  biased  estimators.  This  is 
well  illustrated  in  the  example  cases  in  the  next  section. 

A  technique  to  reduce  leakage, and  hence  the  bias,  is  to 
window  each  segment  of  time  history  hv  multiplying  it  by  a 
data  window.  The  authors  have  implemented  a  cosine  bell  win¬ 
dow  which  is  equivalent  to  convolving  the  complex  discrete 
Fourier  coefficients  with  the  weights  (-1/4,  1/2,  -1/4). 
(Different  windows  are  also  available,  such  as  cubic  and 
quartic.)  Discussion  of  the  merits  of  various  windows  to 
he  selected  is  beyond  the  scope  of  this  paper,  hut  the  im¬ 
portant  fact  is  that  some  windowing  is  required  to  reduce 
leakage. 

Windowing,  however,  results  in  poorer  frequency  resolu¬ 
tion;  that  is,  of  the  effective  frequency  resolution, 
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i 


becomes  greater  by  a  Multiplicative  factor  K,  dependent  on 
the  window.  That  is, 

eft*  " 

and  K  la  approximately  1.44  for  the  cosine  bell  window  when 
Measured  at  the  half  power  point. 

IIX.C.2.  Averaging  the  Spectral  Estimators 

The  second  choice  of  program  parameters  involves  selec¬ 
tion  of  NSEG,  the  number  of  segments  of  data  and  NNN ,  the 
PPT  sixe.  (liven  time  series  data  limited  in  time  and  repre¬ 
sentative  of  two  random  processes,  let  each  time  series  con¬ 
sist  of  NTS  samples.  Then,  for  non-overlapped  segments,  the 
total  number  of  samples,  NTS,  can  only  be  partitioned  as: 

NTS  ■  NNN  *  NSEfi  Eq  .  (3) 

It  is  easy  to  see  but  important  to  note  that,  for  a 
fixed  value  of  NTS,  NNN  can  only  be  increased  at  the  expense 
of  decreasing  NSEC,  and  vice  versa. 

Recall  that  the  frequency  resolution  must  be  made  fine 
enough  to  encompass  all  the  detail  of  the  data's  true  spec¬ 
trum.  Note  that  if  fine  resolution  is  required,  then  the 
PFT  sixe,  NNN,  must  be  made  large,  and  for  a  fixed  total 
number  of  samples,  NTS,  the  number  of  disjoint  segment  NSEC 
becomes  small. 

A  small  value  for  NSEC  leads  to  two  serious  problems: 
low  stability  and  biased  cross  power  spectrum.  For  a  fixed 
value  of  NTS,  NSEC  can  be  increased  at  the  expense  of  de¬ 
creasing  NNN.  This  results  in  better  stability  and  low  bias 
in  the  cross  spectrum  hut  poorer  resolution.  Small  NSEC  im¬ 
plies  less  averaging  of  the  numerator  and  denominator  of  the 
coherence  ratio.  This  is  most  important  in  terns  of  serious 
positive  bias  problems.  The  bias  problem  is  easy  to  see  when 
x(t)  and  y(t)  are  uncorrelated.  Recall  that  if  x(t)  and  y(t) 
are  uncorrelated,  the  cross  correlation  function  is  zero  for 
all  lags  and  its  Fourier  transform  yields  the  complex  cross 
spectral  density  which  is  zero  for  all  frequencies.  Hence 
the  true  coherence  is  zero  for  all  frequencies.  However, 
when  no  averaging  is  done  (i.e.,  NSEfi  ■  1),  then  the  estimate 
of  coherence  (eq.  (7))  can  be  shown  to  he  unity.  This  ser¬ 
ious  positive  bias  can  be  shown  to  decrease  as  the  amount  of 
averaging  increases. 
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Clearly  there  is  a  trade-off  between  the  selection  of 
NNN  and  NSEC.  For  a  fixed  value  of  NTS,  NNN  can  not  be  in¬ 
creased  without  decreasing  NSEC, and  NSEC  can  not  be  in¬ 
creased  without  decreasing  NNN.  The  important  point,  though, 
is  that  paraaeter  selection  for  high  resolution  and  stable 
estimates  is  at  cross  purposes. 

IV.  THE  EXAMPLE  CASES 

Six  examples  are  enclosed  to  illustrate  coherence  esti¬ 
mation.  The  first  example  illustrates  estimating  coherence 
for  two  independent  noise  sources.  The  remaining  five  ex¬ 
amples  illustrate  estimating  coherence  for  system  input/ 
output  relations.  The  plot  labels  of  the  spectral  estimates 
for  the  system  input  is  "A/PHIX,"  for  the  output  is  "A/PHIY," 
for  the  transfer  gain  characterisitics  is  "M0DH2,"  and  for 
the  phase  characteristics  is  "PHASE". 

IV. A.  Independent  Noise  Case 

The  coherence  between  two  independent  noise  sources  is 
estimated  by  averaging  more  and  more  disjoint  segments.  The 
following  set  of  figures  illustrates  the  resulting  coherence 
estimates  for  NSEC  ■  2,  4,  8,  16,  32,  64,  128, and  256.  The 
results  are  most  useful  and  concur  with  work  by  Haubrich, 
reference  (d);  Benignus,  reference  (e);  and  Carter  and  Nuttall, 
reference  (j).  Recall  that  independent  noise  sources  are 
uncorrelated,  and  therefore  the  inverse  Fourier  transform  of 
the  cross  correlation  function  is  zero  for  all  frequencies. 

The  positive  bias  associated  with  estimating  the  numerator 
of  the  coherence  ratio  is  illustrated.  Note  that  as  the 
averaging  increases,  this  type  bias  decreases  and  the  esti¬ 
mate  of  coherence  approaches  the  true  value.  By  averaging 
over  64  segments,  the  authors  achieve  what  can  l>e  considered 
an  acceptable  "estimate"  of  squared  coherence  when  the  true 
coherence  is  zero. 
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IV. B.  Smooth  Filter  Case 

White  Caussian  noise  (flat  spectrum)  is  filtered  by 
the  first  order,  low  pass, digital  filter  specified  by  the 
recursion  equation 

*.  ■  */«  *ii-l  ♦  «/»  *n 

The  enclosed  plots  show  the  auto  spectra  of  X  and  Y 
and  the  modulus  (gain)  and  phase  characteristics  of  the 
filter.  The  coherence  estimate  of  the  filter  is  100%  for 
all  frequencies. 

Note  that  the  estimator  is  unbiased  (since  the  true 
coherence  is  100%)  and  has  zero  variance.  This  behavior 
of  the  coherence  estimator  was  predicted  by  Benignus  (ref. 
(e)).  Carter  and  Nuttall  (ref.  (k)),  and  Carter  (ref.  (1)). 
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The  symmetry  of  the  coherence  function  is  also  illus¬ 
trated  by  designating  y  as  the  filter  input  and  x  as  the 
filtor  output. 
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Quite  naturally  the  estimates  of  the  filter  character 
istics  change.  Note,  though,  that  the  coherence,  being  sym 
metric,  does  not  change. 
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H'.C.  Sharp  Filter  Case 


IV.C.l.  With  Weighting  Function 


White  Caussian  noise  (flat  spectrum)  is  filtered  by 
the  second  order  low  pass  digital  filter  specified  by  the 
recursion  equation: 


AVi  ♦ 


BYn-2  4 


CX. 


where 


A  ■  1.97330 
B  -  -0.98202 
C  -  0.00872 


The  plot  labeled  "A/PIIIY"  shows  the  spectrum  of  the 
filter  output.  The  modulus  and  phase  of  the  filter  are 
displayed  (Note:  the  band  of  sharp  resonance  and  rapidly 
phase  change  at  30  Hz) •  The  true  coherence  is  loot.  The 
estimate  of  squared  coherence  is  given  and  fails  in  the 
band  of  poor  resolving  power  (relative  to  true  spectrum) . 
This  is  a  different  type  of  bias  than  previously  discussed. 
It  can  be  most  severe  when  estimating  coherence.  .  This  be¬ 
havior  of  the  coherence  estimator  was  predicted  by  Jenkins 
and  Watts  (ref.  (c)) . 


21 
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Increasing  the  resolving  power  can  improve  the  co¬ 
herence  estimator  though  for  a  finite  time  history,  in¬ 
creasing  resolving  power  means  decreasing  the  amount  of 
averaging  possible. 

The  same  data  from  the  Sharp  Filter  Case  was  repro¬ 
cessed  with  16  disjoint  pieces  of  size  4096  (vice  64  of 
1024). 
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IV.C.  Sharp  Filter  Case 
IV. C. 2.  With  No  Weighting  Function 

The  "sharp  filter  case"  data  was  used  again  to  estimate  squared 
coherence.  This  tine  the  data  segments  were  not  multiplied  by  a  weighting 
function.  The  FFT  side  lobe  "leakage"  problem,  reference  (f),  corrupts 
the  estimator.  Note  that  even  though  the  true  value  of  coherence  is  100%, 
the  estimator  fails  to  attain  the  true  value.  Also  the  estimates  of  filter 
gain  and  phase  are  not  as  good  as  with  the  use  of  a  weighting  function. 

The  result  dramatically  portrays  the  need  to  apply  a  weighting 
function. 
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The  data  from  the  Sharp  Filter  Case  were  reprocessed  with  NO 
weighting  function  applied  to  the  tine  series  but  with  higher  resolving 
power. 


essed. 


Here  16  disjoint  pieces  of  size  4096  (vice  64  of  1024)  are  proc- 


Note  that  higher  resolving  power  without  weighting  function  still 
yields  poor  results. 


MO  WtlOHTlMO  CAM  40M 
IWtIT  TAM  ■  •  CAM 

Ml  ■  «|N  Ml*  • 

•V  a 


04137)33114*  SI 74 1 /COOP  04)37) 

MI.T 

flt»  a  »  Ml  a  It  m  •  I.NMMm 

H4  •  i  in*  a  wui  a  it 


SOllMtO  COHMl hbCr 


NO  WEIGHTING  CASr  4090 


TM  No.  TD113-19-71 


The  data  from  the  Sharp  Filter  Case  were  reprocessed  with  NO 
weighting  function  applied  to  the  tine  series  but  with  higher  resolving 
power  and  more  averaging. 

Here  64  disjoint  pieces  of  size  4096  are  processed. 

Note  that  the  estimator  is  stabilizing  but  not  about 
the  correct  answer. 
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IV. I),  Tones  Thru  Filter  CA*e 


The  question  of  resolving  power  lends  to  the  investi¬ 
gation  of  tones  through  a  filter.  That  is,  if  there  are 
fine  lines  in  the  input  spectrum,  plot  MA/PI!IX,"  the  coher¬ 
ence  can  be  estimated  for  a  smooth  filter.  The  smooth  filter 
is  again  specified  by  the  recursion  equation: 


Yn  "  7/8  Yn.,  ♦  1/S  Xn 


The  input  sequence  is  generated  hy  summing  noise  and 
two  sine  waves  (one  centered  in  an  TFT  frequency  bin,  one 
out).  The  results  show  our  ability  to  estimate  coherence  in 
this  environment. 
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IV. H.  Variable  Coherent  Case 

White  Gaussian  noise  source  1  (flat  spectrum)  is  filter 
through  the  first  order  low  pass  digital  filter  specified  by 
the  recursion  equation: 

Zn  •  31/32  Znml  ♦  1/32  Xn 

The  output  Zn  is  corrupted  (intentionally)  with  additive 
Gaussian  noise  source  2  (flat  spectrum)  independent  of  noise 
source  1.  The  observed  output  Yn  is  specified  by  the  equation 

Yn  -  Zn  ♦  I/*  rn 

where:  rn  is  noise  source  2 

The  output  Y„  becomes  dominated  by  additive  noise  as  the 
frequency  increases,  hence  the  squared  coherence  decreases 
with  increasing  frequency.  Estimating  the  "transfer  function" 
between  Xn  and  Yn  is  shown. 


This  behavior  of  the  true  coherence  was  predicted  by 
Roth  (ref.  (i))  and  Carter  (ref.  (1)).  The  tendency  for  the 
variability  of  the  estimator  to  be  greater  at  true  coherence 
about  0.3  was  predicted  by  Jenkins  and  Watts  (ref.  (c)). 
Carter  and  Nuttal  1  (ref.  (k)),  and  Carter  (ref.  (1)). 
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IV.F.  True  Coherence  Equal  0.3  Case 

Two  processes  with  true  coherence  equal  to  0.3  for  all 
frequencies  were  generated  (Nutt. ill  and  Carter  ref.  (u)  and 
Carter  ref.  (1)).  The  following  set  of  figures  illustrates 
the  resulting  coherence  estimates  for  NSHR  ■  8.  16,  32,  64, 
128,  and  2S6.  The  variance  of  the  estinator  agrees  with 
theoretical  predictions  (Carter  and  Nuttall  ref.  (k)  and 
Carter  ref.  (1) ) . 
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V.  CONCLUSIONS 

Some  of  the  practical  aspects  of  estimating  the  co¬ 
herence  function  have  been  presented.  The  problems  of  ana¬ 
lyzing  the  results  are  harsh.  The  two  most  significant 
points  are  weighting  functions  and  stability.  First,  a 
weighting  function  must  be  applied  to  the  data  to  estimate 
the  coherence  spectrum.  Second,  averaging  is  renuired,  dic¬ 
tating  time  series  of  long  duration  which  are  stationary 
over  the  period  of  observation. 

Extracting  from  Tick  reference  (b) ,  NI  wonder  how  many 
conclusions  have  been  drawn  over  the  years  because  of  poor 
estimation  procedures." 

This  field  of  spectral  estimation  is  open  to  further 
in-depth  research  and  the  authors  will  not  be  surprised  to 
see  significant  contributions  over  the  next  several  years. 
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Estimation  of  the  Magnitude- 
Squared  Coherence  Function 

(Spectrum) 


Q.  C.  Carter 


ABSTRACT 


A  method  of  estimating  the  magnitude-squared  coherence 
function  (spectrum)  for  zero-mean  processes  that  are  wide 
sense  stationary  and  random  is  presented.  The  estimation 
technique  utilizes  the  weighted  overlapped  segmentation  fast 
Fourier  transform  (FFT)  approach.  Analytical  and  empirical 
results  for  statistics  of  the  estimator  are  presented  for  the 
processes.  Analytical  expressions  are  derived  in  the  non- 
overlapped  case.  Empirical  results  show  a  decrease  in  btas 
and  variance  of  the  estimator  with  increasing  overlap  and 
suggest  that  a  50-percent  overlap  is  highly  desirable  when 
cosine  (Hanning)  weighting  is  used. 
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ESTIMATION  OF  THE 

MAGNITUDE-SQUARED  COHERENCE  FUNCTION  (SPECTRUM) 

I.  INTRODUCTION 


The  complete  probability  ■  tincture  of  the  zero- mean  processes  x(t)  sad 
y(t) ,  which  sre  wide- sense  staticaary  sad  jointly  Gauasiaa,  is  specified  by  the 
spectral  density  matrix. 


M  If) 
*y 


•„<*) 


on 


where 

^M|f)  is  the  (real)  auto  power  spectral  density  function  of  x(t), 

$yy(f)  is  the  (real)  auto  power  spectral  density  function  of  y(t)  ,  sad 
g  (f)  is  the  (complex)  cross  power  spectral  density  function  of  x(t) 
and  y(t)  and  consists  of  a  real  or  coincidental  (CO)  spectrum  and  an  imaginary 
or  quadrature  (quad)  spectrum. 

A  simplifying  ratio  is  the  complex  coherence  function  (spectrum), 


V* 


♦„|f> 


(f)<x»  (f) 

r '  yy  ' 


(1.2) 


or,  more  commonly,  the  magnitude- squared  coherence  function. 


l 
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(1.3) 


The  term  "coherence"  can  Imply  Eqs.  (i.l),  (1.3),  or  the  positive  square  root 
of  Eq.  (1.3). 

Equation  (1. 3)  possesses  a  number  of  useful  attributes:  first,  it  always 

falls  between  sero  and  one.  Second,  it  is  zero  if  the  processes  x<t)  and  y(t# 

are  uncorrelated.  Third,  it  is  equal  to  unity  if  and  only  if  there  exists  a  linear 

2 

relation  between  x(t)  and  y(t). 

These  attributes  are  of  particular  significance  in  sonar  systems  where  a 
waveform  received  at  two  spatially  separated  elements  of  n  hydrophone  array 
may  ba  corrupted  by  additive  noiee  uncorrelated  from  the  firat  to  the  second 


Unfortunately,  the  difficulty  In  estimating  the  true  coherence  has  plagued 

3  1 

modern  statisticians.  An  analytical  expression  was  derived  by  Goodman  for 

the  probability  density  function  of  tbs  estimate  of  magnitude  coherence  |  'y'  | 

when  several  independent  observations  (or  segments)  of  the  processes  art 

available.  A  closed-form  solution  for  the  cumulative  distribution  function,  as 

a  finite  sum  of  hypergeometric  functions,  can  be  found  by  proper  identification 

of  variables  in  the  work  of  Fisher.*  The  application  of  Fisher’s  work  to  this 

problem  is  believed  original  in  this  thesis.  Earlier,  statistics  for  coherence 

5-7 

estimation  were  found  in  tables,  and  graphs,  and  trai  sformations  to  be 

|x*rformed  'in  the  coherence  estimator  were  suggested  so  as  to  "normalize" 

5  9 

(make  Gaussian)  the  density  function.  ’ 


ywS'SwiySiv*1 


Certain  empirical  studies  have  also  been  conducted.  Haubrich  suggested 
that  the  total  time  series  under  investigation  be  segmented  into  a  number  of 
shorter  segments  overlapping  one  another  by  50  percent  and  that  a  triangular 
weighting  function  be  applied  to  each  segment. 7  Tick  showed  empirical  exam¬ 
ples  of  the  types  of  estimates  to  anticipate  when  the  tree  coherence  is  0. 2  and 

3 

mean  lagged  product  techniques  are  used.  Benignus  empirically  showed  the 

bias  and  confidence  intervals  to  expect  when  n  independent  segments  are  proc- 

10 

essed  using  a  rectangular  weighting  function. 

Current  techniques  for  coherence  estimation  involve  applying  the  fast 

Fourier  transform  (FFT). 11  Some  of  the  latest  published  results  an  coherence 

10 

estimation  are  limited  la  scape  to  processes  that  have  relatively  flat  spectra. 

The  problems  sasoc fated  with  nonflat  spectra  oan  be  avoided  through  Judicious 
choice  of  a  time- weighting  (or  windowing)  function.  1S~14  the  use  of  a  weighting 
function  is  necessary  far  data  not  spectrally  flat  and  should  be  prudently  selected 
for  unknown  data.  In  coherenoe  estimation,  tbs  application  of  a  weighting  func¬ 
tion  results  in  wasted  data  (loss  of  stability  and  increase  of  bias)  unless  over¬ 
lapped  processing14  is  employed,  la  underwater  acoustic  environments,  which 
require  weighting  functions  and  good  spectral  resolution,  but  which  remain 
stationary  only  for  limited  amounts  of  time,  such  wastage  can  not  be  permitted. 

This  thesis  empirically  determines  the  effect  of  overlap  processing  on  the 
estimated  magnitude- squared  coherence  function  when  cosine  (or  Hanning,  after 
Julius  von  Ham)  weighting  has  been  applied. 

The  empirical  method  for  determining  the  effect  of  overlap  has  been  limited 
in  scope  to  a  cosine  weighting  function,  a  finite  time  history,  and  a  desired 
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H.  COHERENCE  FUNCTION  (SPECTRUM)  AND  ITS  USES 


Thin  chapter  defines  the  coherence  function  (spectrum).  Additionally,  it 
reviews  thaee  terms  necessary  for  its  definition  or  helpful  in  its  estimation. 
Finally,  this  chapter  presents  some  examples  of  the  uses  of  coherence  to  lay 
a  background  for  why  this  particular  function  is  meaningful. 


II.  A.  COHERENCE  FUNCTION 

The  essense  of  the  coherence  function  is  a  collapsed  power  spectral  density 
matrix.  To  fully  appreciate  the  intricacies  of  its  definition,  it  is  first  necessary 
to  review  some  basic  concepts.  They  include  the  correlation  matrix,  wide- 
senae  stationarlty,  ergodicity,  Gaussian  assumption,  and  power  spectral 
density  matrix. 

II.  A.  1.  Correlation  Matrix  and 
Wide- Sense  Stationarlty 

The  general  correlation  function  between  zero- mean  processes  x(t)  and 
y(t),  which  are  real  and  nonatationary,  is  defined  by  Davenport  and  Root. 15  as 
follows : 

Rxy(ti'  V  *  E[*<vy<v]  ’  <*  “ 
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(2. 13b) 


Although  the  form  "coho roue* "  eoa  imply  Eqo.  (2. 8),  (2. 12),  or  (2. 13),  it 
uotmlly  rotors  to  Iq.  (S.  13). 

For  oooo  of  nototioo,  tho  dopondonco  on  f  is  of  ton  not  specified;  for 
example , 
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II.  B.  USES  OF  COHERENCE  FUNCTION 


The  m«|Ritvde-M|Mred  eohemtv  function  for  the  hero- mean,  »ide-*en»c 
stationery  proceaeea  xft)  and  y(l)  la  ueeful  in  several  ways,  which  will  be 
pro v««d  In  the  following  auctions.  First,  for  two  processes  that  are  limarlv 
rc luted,  the  magnitude-squared  coherence  function  is  unity.  Second,  for  two 
independent  processes,  ths  magnitude-squared  coherence  function  is  aero. 

Third,  under  the  assumptions  to  bo  presented,  the  magnitude- squared  coherence 
function  serves  as  s  signal- to- noise  measure. 

11.  B.  1.  A  Measure  of  System  Linearity 

The  magnitude  squared  cohere  nee  function  can  be  used  to  measure  system 
linearity. 12  In  Pig.  I  consider  the  linear  system  with  input  x(t|‘,  impulse 
response  h(  r)  .  and  output  yft)  ■  The  output  y(t)  Is  expressed  by  the  con¬ 
volution  integral 


Fig.  1.  Linear  System  with  Impulse  Response  h(r) 


The  fragoancy-doasahi  ifihtlirt  la  a  nnlttpHeattoa  obtained  via  the 


Poarlar  transformation; 

YH)-H(DX|0 


(2.W) 


If  x(t)  la  a 


sample  function  of  a  itaHwary  random  process. 
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than 


♦w(f) -«(!)♦„(!) 

xy  xx 


(2. 17) 


and 


♦yytf)  -  H(f)  M*(f)«n(f)  *  H(OOx*y(f)  .  (2. 18) 


flbica  tha  magnitude- aquared  ooharanoa  doflnad  by  Eq.  (2. 13)  can  ba 

« 

written  as 


7  (f) 

*T 


♦x,”  W 


(2.  It) 


application  of  Eqs.  (2. 17)  and  (2. 18)  ytalds 


y  (0 

xy 


H(f) 


M  ,  Vf  • 
H(f) 


(2.20) 


Consequently,  the  magnitude- squared  coherence  between  the  input  and  output  of 


1  2 


a  linear  system  is  unity. 
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11.  B.  t.  A  Measure  o i  Correlation 


U  tlM  nro-MU  processes  x(t)  and  y(t)  are  Independent,  they  are  also 


orrelated  aad  orthogonal;  that  la 


*  <*)  -  E  [x(t)y(t  ♦  r  )]  -  E  [x(t)]  E  [y(l  ♦  r  )]  -  0  , 


QD 

^  (f )•  f  R  (f)e”^*r  fdr  -0  , 
xy'  J  *T 


(2.21) 


(2. 22) 
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(1.23) 


i,  If  the  two 


or  enoorrelated  with  aero 


la  aero. 


II.  B.  3.  A  Measure  of  Bignal-to-Noiee  Ratio 


Consider  a  signal.  s<t)  ,  passed  through  two  linear  fillers  and  received 
at  two  sensors  where  U  la  corrupted  by  uncorrelated  additive  noises.  The 
received  waveform  at  each  sensor  la  then  panned  through  two  linear  filters,  as 
shewn  In  Pig.  2. 


Assume  that  s(t)  ,  n^ft)  ,  aad  a2<t)  are  uncor related;  that  is. 


E  £n^(t)  Bj(t  ♦  *)]  -0  . 
E  [n^t)  s(t  ►  r)  ]  -  0  , 


(2.24) 


(2.  25) 
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III.  COHERENCE- ESTIMATION  PROCEDURE 


The  procedure  for  estimating  the  coherence  or  magnitude- aqua  red  coherence 
functions  for  wide- sense  ergodlc  (and,  hence,  wide- sense  stationary),  sero- 
mean  random  processes  x(t)  and  y(t)  is  discussed  in  this  chapter.  (References 
within  this  chapter  to  x(t)  and  y(t)  apply  to  those  specific  processes  with  the 
noted  characteristics,  that  is,  zero-mean,  wide-sense  ergodic. )  The  basic  ob¬ 
jective  is  to  obtain  estimates  of  the  elements  of  the  spectral  density  matrix. 


xy 
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XX 
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xy 
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(3.1) 


in  order  to  form  the  magnitude- squared  coherence  estimator. 

The  estimation  procedure  described  is  the  direct  method,  which  is  discussed 

21  22  11  10  14 

in  part  by  Welch,  Knapp,  Bingham,  Benlgnus,  Nuttall,  and  Carter 

12 

and  Arnold.  It  includes  cosine  weighting  and  overlapped  processing  and  is 
used  because  of  the  computational  advantage  of  the  FFT. 11 

Briefly,  the  method  implemented  consists  of  obtaining  two  finite- time  series 
from  the  random  processes  being  investigated.  The  time  series  are  segmented 
into  n  segments,  each  having  P-data  points.  For  example,  from  each  process 
there  may  be  32  segments,  each  segment  having  4096  points.  The  segments  may 
Imj  overlapped  or  disjoint.  Each  segment  is  multiplied  by  a  weighting  function. 
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Tltnlivt,  far  euampie,  If  T  ■  1  of  a  •  | .  than  pq  *  50  percent.  Whami 
If  T  •  1  Mi  a  - 1/4.  than  p#  -  H  parcat. 
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that  la,  aa  overlap,  A  data  lied  aaalyeis  of  the  effect  of  overlapped  weighted 
asguMatatton  far  estimating  auto  power  apoetral  density  functiooa  la  given  by 


Iff.  R  COHERENCE  ESTIMATOR 

Lai  ,  where  p«l,  1,1 . M  denote  the  P- point  sequence 

abtalaad  frawi  the  alb  weighted  segment  of  prooeea  x(t) .  .  la  estimating  the 
eaharaaoa  faaattaa,  it  la  aaoaaaary  to  evaluate  a  traaafonaatioa  of  this  weighted 
aoguaooa.  The  FfT  la  a  feat  algorttbat  for  evaluating  a  apodal  eaee  of  the 
Z-traaofona  af  a  finite  aaquonoo  of  numbers.  The  two  sided  Z-transform  of 
aa  laflatta  ssqusnos  Is  defined  by 


a> 

*,<■>"£  *tD‘P  *  (3'4) 

p*  -a>  K 

13 

where  a  equals  any  couples  variable. 

Evaluation  of  the  Z- transform  at  P  equally  spaced  points  around  the  unit 
circle  for  a  P- point  sequence  yields  the  P- point  OFT:23 


P-1 


E 

p-0 


x  e-)2vfkp/P 


(3.5) 


22 
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wten  x  is  the  finite  weighted  sequence,  p-0,1 . P  -1,  sad 

•P 

1*1,1 . a.  Equation  (3.5)  can  ba  evaluated  for  k  ■  0 ,  1, .  .  ..  P-1. 

with  a  fast  algorithm  requiring  on  the  order  of  P  log2  P  complex  multiplications 
and  additions. 11 

Similarly,  a  vector,  y#(^)  ,  is  formed  for  each  segment  (that  is, 

s  •’  1  ,  2,  •  •  ..  a). 

The  estimate  of  the  auto  power  spectral  density  function  of  x(t)  at  the  kth 
frequency,  obtained  from  the  sth  weighted  segment,  Is  given  by 


*„.«V 


*[xa>x;<v] 


where  At  *  l/f 


(3.6) 


Similarly, 


(3.7) 


and  the  estimate  of  the  cross  power  spectral  density  function  is 


Ky  ■  7  [  w  w] 


(3.8) 


Equation  (3. 8)  can  be  rewritten  in  terms  of  the  real  and  imaginary  parts. 


and 


Vv’p'1*  [ww| 
\v~  ""  [x.'VY;v] 


(38) 


(3.  10) 
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Ns*.  tbs  aaUmatm  at  tbs  alemsats  of  tbs  power  opoetral 
an  Mud  by  ssse  aging  war  tbs  aaasber  at  segments,  a  . 


tty  matrix 
estimate  of 


(3.11) 


vhm  k  Mhm  Uw  dtoona  frequency  of  interest  sad  a  to  Uw  mimbor  of 


Rio  of 


(3. 12) 


yields 


%V 


■ 

iS 


iwwl1 
six  *.<u  *:  «vY.v  r:<v 


it 


wwww 


■-1  wwww 


»  l 


(3.13a) 


(3. 13b) 


This  (act  Is  so  basic  that  it  is  often  not  discussed.  However,  it  points  out 

|/\|2 

that  regardless  of  the  value  of  the  true  magnitude- squared  coherence,  |  y  |  >1.0 
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wbea  a  ■  1  .  Coaaaqutatly,  Mm  MtiMM  la,  la  ftaaral,  biaaad;  the  actual  Maa 
dapaada  oa  |  y  |*  tad  a  .  la  practiea,  a  aboald  ba  large,  aa  will  be  ahown. 
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IV.  STATISTICS  OF  ESTIMATE  OF  COHERENCE 

Goodman,  ia  his  Bqs.  (4.  SI)  and  4.  SO), 1  derived  an  analytical  expression 
iar  Um  probability  density  function  of  the  magnitude-coherence  aotlmato,  |  y'  |  , 
based  on  Eqs.  (3. 11)  and  (3. 12).  IBs  results  wore  based  an  two  xero-meen 
processes  that  were  stationary,  Gaussian,  and  random  and  had  been  segmented 
into  n  independent  observations  (that  is,  nonoverlapped  segments).  Each  seg¬ 
ment  was  assumed  large  enough  to  ensure  adequate  spectral  resolution.  Further, 
was  assumed  perfectly  weighted  (windowed),  in  the  sense  that  the 


Fourier  coefficient  at  some  kth  frequency  was  to  have  "leaked"  no  power  from 

24 

other  Mas.  However,  Hannan  points  out  that  the  statistics  do  not  hold  at  the 
seroth  or  folding  frequencies. 

The  material  in  this  chapter  relating  to  magnitude-squared  coherence  is 

25 

believed  to  be  new  (Carter  and  Nuttall  )  and  is  a  direct  extension  of  Goodman's 
work. 1  All  of  Goodman's  original  assumptions  hold.  Statistics  of  the  magnitude- 
coherence  estimator  are  given  in  Appendix  A. 


IV.A.  PROBABILITY  DENSITY  AND  CUMULATIVE 
DISTRIBUTION  FUNCTIONS 


The  first-order  probability  density  and  cumulative  distribution  functions  for 
the  estimate  of  magnitude- squared  coherence,  given  the  true  value  of  magnitude- 
squared  coherence  and  the  number,  n  ,  of  independent  segments  processed. 
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arc  presented  in  closed- form.  The  expressions  are  evaluated  and  plotted. 


IV.  A.  1.  Probability  Density  Function 


The  conditional  probability  density  function  for  the  estimate  of  magnitude- 
squared  coherence,  |^|2  .  between  two  processes,  Riven  |  >  |  2  and  n  ,  is® 


>0 


pil?  N».  *12 


n-2 


•  ,F,£.  nil;  M2  p|2)  .  OS  M2PI 

Pl”0"l,]‘  • 


<  1 


(4.1) 


it  then  follows,  knowing 


that 


>(|*1  |  n,|y  «p(|>|  l|n.|>  |*  )  2^1  •  (4.2) 


1 


Equation  (4.2)  can  be  shown  (Appendix  A)  to  be  Goodman's  result.  The 


density  function,  Eq.  (4. 1) ,  can  be  rewritten  using  Eq.  (15.35)  of  Abramowitz 
in  the  following  alternate  forma: 


26 


Pll^l2  I  “•  *  ‘  2 


)-  (n-  |2)  (l-|?|2) 


-2 


.  (l-|-»l*|'»|8)1'**  |2p|2)  (4.J) 


and 
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<n-  l) 


'll 

(-IV) 

(>-M* 

LbJlliii) 

(St 


M- 


Equations  (4. 3)  and  (4. 4)  are  desirable  because  2Fi^~b'  1  "  n  '•  1 :  |  y  I  *  I  7  |  j 
can  be  expressed  as  aa  (n  -  l)st  order  polynomial  (Abramowitz,  Eq.  (IS.  4.1)  ) 
A  special  caaa  of  the  danaity  function  occurs  when  \  y  |2  *  0.0  .  la  that  event, 


(»-  1) 


(4.5) 


IV.  A.  2.  Cumulative  Olatributloa  Function 

Fisher, *  working  on  statistics  of  the  estimate  of  the  squared  correlation 
coefficient,  derived  the  probability  density  for  that  random  variable.  He  inte¬ 
grated  the  result  and  achieved  a  closed- form  solution  for  the  cumulative  distri¬ 
bution  function;  specifically  the  solution  was  a  finite  sum  of  ^  functions, 
each  one  a  finite- order  polynomial.  Although  these  statistics  are  for  a  different 
problem,  proper  identification  of  variables  yields  exactly  the  integration  for¬ 
mula  needed  to  find  the  cumulative  distribution  of  the  estimate  of  magnitude- 
squared  coherence,  namely. 
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‘'It—  )  z(  —  —  -) 
v  1  '  (L,.ui*r?i*/  — V.-m*  m*/ J 


M- 


k  I  -  i» .  I  .  > 


!KI2) 


In  (hr  special  ease  when 


I  .  2 

j  >  0  .  Ihr  ci 


ii  mu  1st  I  vc  distribution  function 


becomes 


c(l»|*|..  i>l‘ 


«Uch  can  be  ilmpliM  to  give 


Equation  (4  8).  when  differentiated,  vialda  the  probabflitv  density  function. 


Eq.  (4  5). 


IV.  A.  3.  Computer  Evaluation 


The  probability  density  function,  Eq.  (4.4).  can  ba  evaluated  rcadllv 
on  a  large  digital  computer  In  floating- point  arithmetic.  Evaluation  for 
100  valuea  of  I  T  |*  between  0.0  and  0.99  requires  computing 


100  (n  -  list  order  polynomials  for  each  value  of  |>  |  and  n  Th« 
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cumulative  distribution,  Eq.  (4.6),  can  be  similarly  evaluated.  The  density 
function  and  the  cumulative-distribution  function  were  computed  as  illustrated 
in  Fig.  S  for  ten  values  of  |  y  1 2  and  for  n  =  32,  40,  48,  56,  and  64.  (The 
computations  and  100  plots  were  done  on  the  UN IV A C  1)08  in  less  than  5  min¬ 
utes.  )  Example  plots  are  included  in  Figs.  6  through  13. 

One  example  of  how  these  plots  can  be  used  is  as  follows:  Magnitude- 
squared  coherence.  |  2  ,  is  estimated  by  averaging  over  32  disjoint  seg¬ 

ments  of  data  (that  is,  n  *  32).  Suppose  the  estimated  value  is  approximately 
0.3,  then  from  Fig.  7 

Proto  I't'I2  |  a  -  32, |  7  |  2  -  0.3  ,) 

*  f  p(M2|n*32*l1r|2*0'3)  dl^2  (4-9a) 

and 

9l'f(D  pf(p|2|n*32,  |*r  |2-0.3^  dl'r)2  , 

(4.9b) 

Equation  <4. 9b)  could  be  set  equal  to,  for  example,  0.9,  and  the  value  of 
L,  from  Fig.  6,  is  0.2. 

The  upper  limit  is  found  from 


»hich  could  be  set  equal  to,  for  example,  0.9,  and  the  value  of  A  .  from  Fig.  7, 


is  0.43.  Hence, 
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pf!,l.-»*.M1-°  »)dl^2-o  «  *  (411> 

On  Um  basis  of  Eq.  (4.  II),  tbs  probability  that  the  estimator  falls  in  the 
rap  ft.  2,  t.  42)  is  0.  t,  given  that  the  exact  value  of  the  unknown  parameter 
was  t.  3  sad  that  32  dtejotat  segments  ware  used. 

Proper  use  of  the  cumulative  distribution  function  yields  confidence  intervals 
for  the  estimate  of  magnitude  squared  coherence  or  any  "one  for  one"  trans¬ 


formation  of  it,  such  as  the  positive  square  root  or  10  log 
for  example,  Cramer*7  or  Carter  and  Nuttall. 29 ) 


/J2L) 


10 


(See, 


IV.  B.  mth  MOMENT  OF  DENSITY  FUNCTION 


Tbs  nth  moment  of  the  magnitude  squared  coherence  is  given  by 

« 

*  [(^TU 1’ l’]*£~  i’ !8)(R,)m -PI*- 

*n- i)(i -|t i*) / 


where  use  has  been  made  of  the  density  function,  Eq.  (4. 1) . 
Application  of  Eq.  7.512(12)  by  Gradshteyn28  yields 


40 
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r/ys„«|  i  i.l  /  .  r«  r<«*i) 

(mj  -M  rv'M  )  - 

1'  '  1  J',/  I*  (n  +  m) 


3r2  ^m  ♦  1.  M;  m  ♦  n,  1;  |>  |2)  .  (4.13) 


The  three- 1  wo  hype  rgeomc  trie  function*  denoting  three  numerator  terms 
and  two  denominator  terms  are  given  by 


®  (R)k(b>k<c).  * 

F  (a,  b,  c;  d.  e;*)-£ — — — - .  (4.14) 

k-0  (d)k(«)k  K 

20 

where  the  (a)fc  notation  is  Pocbhammer’s  symbol  defined  by 

(a)  ft  r<>—  .  (4. 15) 

r(*) 

The  mth  moment  for  the  estimate  of  magnitude-coherence  is  given  in  Appendix 
A. 

These  results  can  be  verified  through  proper  identification  of  variables  in 
the  work  oi  Anderson,  who  extended  Fisher's  original  work-*  on  the  squared 
correlation  coefficient. 


IV.  C.  BIAS  AND  VARIANCE 

I'M  2 

This  section  deals  with  the  bias  and  variance  of  the  estimator  |  T  | 

Exact  and  approximate  expressions  are  presented.  In  addition,  computer 
evaluation  of  the  exact  expressions  is  presented  to  lend  meaning  to  these  results. 

4  1 
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IV.C.i. 
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rowMir  me m  Ik*  flnt 

odlMlt  at 


at  lk»  probability  demalty  function  (or  Uw 
TUa  noMat  eu  b*  written 


«|r?li|  a,  M*J-  - — — “ -  jF^.n.n;  •  »• 

If  jy|2  «  i.o,  F  »  ao ;  therefore,  the  evaluation  of  Eq.  (4. 16)  la  not 
3  Z 

meaningful.  When  Jt|*  -  0.0 ,  *  1.0,  which  yield* 


16) 


■(Wl  M*-**)- *  • 


(4.  17) 


Tedious  manipulation  of  Cq.  (4. 16)  (Appendix  B)  yields  the  simpler  result: 


An  extremely  useful  approximation  can  be  made  by  expanding  Eq.  (4. 18)  to 
obtain 

«(lt|,kM,)»*«a=LH,»  (H2)* 

'  n  n  ♦  1  (n  ♦  l)(n  ♦  2)  ' 


18) 


_ ii- iL 11 _ (N«V 

(n  ♦  l)(n  ♦  2)(n  ♦  3)  '  ' 


(4. 18) 


Computation  of  higher  order  approximating  polynomials  is  also  easily  performed 
and  is  based  on  an  analytical  expression  for  *(|?l2kM2) . 
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The  biu  or 


MtiMtlon  error  It  defined  u 


Bias  $  e(!^2|  ».  |  -r  |2^  - 


(4.20) 


From  Eq.  (4.1»), 


expression  for  the  bias  ie 


Bus  * 


i.iz-L  |,|>  , 

a  n  ♦  1  ' 


(4.21) 


Expending  Eq.  (4.21)  gives  the  approximation 


n  n  ♦  1 


<n  ♦  im  *  1) 


(a  ♦  i)u  ♦  2)U  ♦  3) 


B  >  0 
o 


B  <  0 
o 


(4.22i 


(4.221 


As  an  example  of  using  this  approximation  for  n  ■  8 ,  the  exact  bias  lies  in  the 


range  (0.0,  0. 125),  depending  on  |v  |  ;  and  the  maximum  difference  between 


Eqs.  (4.21)  and  4.22)  U  0.0027  at  >  -0.06.  For  large  n,  Eq.  (4.22a 


and  b)  reducee  to 


a  i(i-  M*) 


(4.  22< 


It  should  be  noted  (see,  for  example,  Eqs.  (4. 22a)  and  (4.  22b))  that 


11m  (Bias)  ■  0  ; 


n  — »  cd 


therefore,  the  estimator  may  be  referred  to  as  asymptotically  unbiased. 


VR  414 S 


f<vmd  bv  Baaipitf  to  bt 


-  I >1  *>  . 


<4  141 


Ofa  Ufa  tow  oorvo  tor  |  >  l*-4.4  and  ! >1*  -  »• 


Eq-  H- He),  —  otytfaolly  derived,  bi  need  toe 


tan  for  bit*, 


reeuit. 


eq.  <4*4». 


far  mmU  i. 


w  ll»  bine  far  any 


.  It  cm  be 


far  Mm  Mm  ef  ^  |  *  easing  to  tnouffletant  efreetral  resolving 


too  imB)  fa  B>vm  by  Jeoktoe  so4  Watts,  hut  fa 


IV.C.l.  Vi 


af  too  sett 


ly.  too  oocood  moment  about  the  mean 


fa  given  far 


Variance 


o  V  -  *|(l^l*)  j  -  [E(l^l*)] 


<4  25 


of  too  deaetty  function  fa.  as  a  c 


of  Eq  14.  16), 


F  1  ..  n,  n.  n  2.  .  y  '  <4  2« 

.1  2  ' 


IM»rn  >  *0.0.  Eq.  <4  26*  yields  the  result 


y  1 
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(4.27) 


An  exact  expression  for  ths  variance  of  is  obtained  from  Eqs.  (4.16), 
(4  25),  and  (4.26).  The  result  is 

V  .  g-L-llll  r^.» . !,l;!>|2) 

n(n  ♦  1)  '  ' 

3F2^2.n.n;n  +  l,l;!7|2) 


For  the  special  case  of  |  >  | 2  ■  0. 0  , 

2 


b(d  *  1)  \n  '  n  (n  +  1) 


(4.28) 


(4.29a) 


and 


*  -a. 
2 
n 


1  1 2 
—  ,  for  Urge  n  and  >(  “0.0 


(4.29b) 


In  order  to  avoid  tedious  and  error-prone  hand  manipulation,  computer- 

aided  formula  manipulation20  of  Eq.  (4. 26)  was  used  to  yield  an  approximation 
('"Mg 

for  the  variance  of  |  7  |  .  Ths  result  is 
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0-1)  [l  .  .t  to3  -  n2  -  »  U.  f|„|»\* 

a(n  ♦  1)  In  n  ♦  2  (a*  l)(n  ♦  2)<a  ♦  3) 


*  2 


n4  -  6p3  -  n2  +  lOn  -8 
(n  +  l)(n  +  2)  <n  +  3)<n  +  4) 


w 


13n5-15n4-113n3  +  27n2  +  136n-120/j.r|2\4  I  (4 

(n  +  l)(n  +  2)2  (n  +  3)(n  ♦  4)(n  ♦  S)  V  '  J 


or 


V - 


V  ,  V  >  0 
o  o  - 


0  ,  V  <  0 
o 


30a) 


<4. 30b) 


As  sn  example  of  using  the  approximation  given  by  Eq.  (4. 30)  for  n  *  8 , 
the  exact  variance  lies  in  the  range  (0. 0 ,  0. 031) ,  and  the  maximum  error  dkw 


to  the  approximation  in  Eq.  (4. 30)  is  0.0067  at  |  7  |  -  0.83.  This  result  is 

g 

a  generalization  of  the  third-order  approximation  by  Jenkins  and  Watts,  which 

I  2 


has  no  zeroth  order  term;  that  is,  it  assumes  no  variance  of  J  7  |  when 
2 


7  -  0.  0. 
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In  particular,  for  large  n  and  |  7  |  4  0  ,  Eq.  (4. 30)  reduces  to 


V  =  -  7  i  2 


(4.31) 


which  has  a  maximum  value  of  8/27n  at  7  '  -  1/3  . 
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TABLE  1 

BIAS  AMD  VARIANCE  OP  |7l 2  FOR  n  »  32 


0 


E(i4i2) 


Bias 


ooooo 
40obo-01 
•Quo O-Oi 


3x260-01 
6*870-0 X 
1*658*00 


31260-01 

26O70-0J 

26979-01 


,18939-02  • 
.75808-02  . 
•15823-01  . 


Variance 


91738-03 

28377-02 

48634—02 


•ittuuo+oo 

•16000*00 

•*0ob0*00 

•24000*00 

•26o00*00 

.32000*00 

•36o00*00 

tNoOOtOO 

•48000*00 
•52000*00 
•56000*00 
•60o00*00 
•64U00*00 
•68000*00 
•72000*00 
•76000*00 
•80000*00 
•84000*00 
•88000*00 
•92tf 00*00 
•96000*00 
•10000*01 


1*438*00 
1*2*7*00 
2*026*00 
29832*00 
20640*00 
3*674*00 
3/309*00 
4 i 153*00 
4*807*00 
4*671*00 
6*744*00 
5*627*00 
6*619*00 
6*422*00 
6*336*00 
7*256*00 
7*189*00 
80131*00 
8*004*00 
0*047*00 
9*021*00 
9*005*00 

It; 00 0*01 


24378-01 

22*67-01 

20247-01 

18310-01 

16402-01 

14730-01 

13080-01 

11633-01 

10072-01 

87068-02 

74379-02 

62661-02 

51920-02 

42165-02 

33402-02 

25640-0* 

10806-02 

13147-02 

84326-03 

47491-03 

21019-03 

46847*04 

00000 


•26654-01 
•40110-01 
•66227-01 
•75061-01 
•96590-01 
•12091*00 
•16805*00 
•17003*00 
.21091*00 
•26672*00 
•28551*00 
,32732*00 
•37220*00 
•62010*00 
•47132*00 
,62566*00 
•60326*00 
,64416*00 
,70041*00 
•  77606*00 
•04717*00 
,92100*00 
•10000*01 


•58069-02 

•68888-02 

,77162-02 

.03127-02 

.06866-02 

.08624-02 

.08513-02 

.06732-02 

.03462-02 

.70095-02 

.73225-02 

.66654-02 

•59391-02 

•51651-02 

.43659-02 

.35644-02 

.27045-02 

.20509-02 

.13091-02 

•02562-03 

•30001-03 

.10573-03 

•00000 


49 


tft  4343 


TABLE S 

BIAS  AMD  VARIANCE  OP  l4 1 *  FOR  n  -  40 


t 


Itl 


E(|$l*> 


Mm 


OOuOO 

40000-01 

00000-01 

iaooo*oo 


2d000-01 

61005—01 

1U124400 

11047400 


25000-01 

23005-01 

21243-01 

19474-01 


*  6  i4i2i]2 


12195-02  . 
61677-02  • 
13704-01  , 
24099-01  . 


Variance 


59451-03 

2160C-02 

35342-U2 

46450-02 


•16000400 

•20000400 

•24000400 

•20000400 

•32000400 

.36900490 

•40000400 

.44000400 

•40000400 

•12000400 

•16000400 

•60000400 

•64000400 

•60000400 

•72000400 

•76000400 

•00000400 

.04000400 

•00000400 

•92000400 

.96000400 

.10000401 


1/770400 
21616400 
26461400 
29314400 
3*174*00 
37042400 
40910400 
4*001400 
% 4692400 
12191400 
5o49§400 
60412400 
6*331400 
6*265400 
72203400 
7*150400 
00104400 
040*7400 
6*030400 
9*017400 
9*004400 
1*000401 


17779-01 

16110-01 

14612-01 

13141-01 

11749-01 

10421-01 

91000-02 

00137-02 

69239-02 

19117-02 

49776-02 

41222-02 

33499-02 

2*490-02 

20322-02 

14960-02 

10400-02 

66704-03 

37127-03 

16160-03 

37304-04 

00000 


•37l4i-0l 

.12942-01 

•71132-01 

•92942-01 

•11721400 

.14431400 

.17442400 

,20744400 

.24344400 

.20247400 

•32411400 

.36973400 

•41003400 

,46930400 

•52410400 

•10210400 

.64330400 

,70703400 

•77572400 

,04701400 

•92176400 

.10000401 


,55357-02 

•62174-02 

•67043-02 

.70106-02 

•71507-02 

•71391-02 

•69912-02 

•67223-02 

•63404-02 

•10059-02 

•13111-02 

•47621-02 

•41364-02 

•34916-02 

•20465-02 

•22204-02 

.16329-02 

.11044-02 

.65547-03 

.30709-03 

,04045-04 

.00000 


TABLE  3 

BIAS  AND  VARIANCE  OP  I >  I  2  FOR  n  -  48 

:>i2  £(,$!*>  BIm  E[(l4l232  VarUnc* 

•00000  *40034*01  .? 0033-01  . 05034-03  .41631-03 

.40000-01  .5*231-01  .10231-01  .62854-02  .1776/-02 
.80000-01  .9/691-01  .17091-01  .12468-01  .29247-02 
•12u80+00  .14621+00  .16213-01  .22425-01  .30/10-02 
•16000+00  .1/480400  .14797-01  .45101-01  .40273-02 
•20U00+00  .2x344+00  .13443-01  .50764-01  .52054-02 
•24000+00  .26215400  .12153-01  .69199-01  .56175-02 
.20000400  .2*093400  .10926-01  .90513-01  .50750-02 
•32000400  .3*976400  .97616-02  .11474400  .59929-02 
•36000400  .3o066400  .06615-02  .14109400  .59016-02 
•40000400  .40763400  .76254-02  .17201400  .50552-02 
•44000+00  .4+665400  .66530-02  .20513400  .56269-02 
.40000400  .4*575+00  .37469-02  .24126400  .53106-02 
.52000400  .58491400  .49051-02  .20045400  .49201-02 
.56000+00  .56413400  .41206-02  .32271400  .44700-02 
.60000400  .68342400  .34179-02  .36009400  .39746-02 
.64000400  .6+277400  .27732-02  .41661+00  .34491-02 
•60000+00  .68219400  .21940-02  ,46030400  .29000-02 
•72000+00  .78160400  .16032-02  .52320400  .23691-02 
•76000+00  .7*124+00  .12306-02  .50133+00  .10462-02 
.00000+00  .08006400  .86127-03  ,64274+00  ,13565-02 
.84000+00  .8*055400  .55169-03  .70744+00  .91652-03 
•OBuOO+OO  .0o031+00  .31001-03  .77549+00  ,54359-03 
.92U00+00  .92014+00  .13637-03  .84691+00  .25541-03 
.96000+00  «9o003400  .29739-04  .92173+00  .71213-04 
•10000+01  .18000+01  .00000  .10000+01  .00000 
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Variance 


TABLE  4 

■At  AMD  VARIANCE  OF  |4|2  TOR  a-M 

hr  I*  1041*)  BtM  EQ|$|2fl2 

•09000  •1/007*01  • 17057*01  .00657-03  •30769-03 

•O0000-01  .boAOO-01  *10000*01  •06000-00  .10900-00 
•00000*01  .00157-01  .15157*01  .11509-01  ,00903-00 
.10909+00  .13009+00  .13007*01  .01000-01  .33170-00 
•16000+00  .1/867+00  .12671*01  .33791-01  .39751*00 
•20900+00  .21151+00  .11510-01  .09215-01  .00769-00 
•20900+00  .OaOoO+OO  .10002*01  .67535-01  .00339-02 
.20000+00  .09935+00  .93090*02  .00700-01  .50571-02 
•32000+00  .30035+00  .03510-00  .11297+00  .51577-02 
.35900+00  .39761+00  .70000*02  .10010+00  .51070-02 
• 09909+09  .09552+00  .55205-00  .17030+00  .50366-00 
.00900+00  .9*699+00  .55900*00  .00300+00  .00303-00 
•00900+00  .09091+00  .09119-00  .23970+00  .05602-02 
•52000+00  .50019+00  .01913*02  .27900+00  .02260-02 
•55000+00  .So363+00  .35270*02  .32100+00  .30376-02 
.50000+00  .90292+00  .29190-02  .36692+00  .30103-02 
•50000+00  .54237+00  .23670-02  .01559+00  .29575-02 
•50000+00  .6ul07+00  .10735-02  .06700+00  .20926-02 
•72000+00  ,7*104+00  .10360-02  ,52250+00  .20206-02 
•76000+00  .7ol06+00  .10566*02  .50079+00  .15000-02 
.00000+00  .00073+00  .73009-03  .64230*00  .11601-02 
.00000+00  .0*007+00  .07025-03  .70717+00  .70333-03 
.00000+00  «0o026+00  .26003-03  .77533+00  .06030-03 
.92000+00  .9*012+00  .11579-03  .60663+00  ,21032-03 
.96000+00  .9o002+00  .20260-00  .92171+00  .61730-00 
.10000+01  .10000+01  .00000  .1000U+01  ,00000 


TABLE  S 

HAS  AND  VARIANCE  OF  I  >  1 2  FOR  a  -  <4 


iTM 


E(  l4l*) 


Bias 


E[(l$|*fl2 


Viriuce 


>00000 


.lj62b-01 


15425*01 


.40077*03 


.23663-03 


•40000*01 
•OOuOO—Ol 
• 12*00400 
.160*0400 
•  20(100400 
•24000400 
•26O00400 
.32000400 
•3»OO0400 
.40000400 
•44O00400 
.40000400 
•62000400 
•56*00400 
•60000400 
.64000400 
•60000400 
•72000400 
•76O00400 
•00000400 
•04000400 
•00000400 
.92000400 
•96000400 
.10000401 


•64416-01 
•9j260— 01 
•lotl4400 
•1/100400 
•2a006400 
•24900400 
•2u0i7400 
.3.730400 
•3*047400 
•4*070400 
•4*497400 
•4*429400 
•523*6400 
•59300400 
•6*255400 
,64207400 
•6*163400 
•7*125400 
•  7*092400 
•0*064400 
•04041400 
•04023400 
•9*010400 
•9o00*400 
•1*000401 


14410*01 
13250*01 
12140*01 
11000*01 
10062*01 
90924*0* 
01707*02 
72971*0* 
64720*0 * 
56906-02 
49676*0* 
42007-02 
36609*02 
30703-02 
25473*02 
20650*02 
16342-02 
12527-02 
92125-03 
64025-03 
40970-03 
22900-03 
10040-03 
20237-04 
00000 


,42499*02 

•10071-01 

.20365*01 

•32752-01 

,4*053-01 

.60209-01 

•47401-01 

•11165400 

.13002400 

•16901400 

•20224400 

•23054400 

.27792400 

•32042400 

•36606400 

•41404400 

.46601400 

•52190400 

•50030400 

•64204400 

,70697400 

.77521400 

,04670400 

,92169400 

.10000401 


• 12006**2 
•217*3— *2 
.29030**2 
•34042-02 
.39273-02 
•42422-02 
•44306-02 
•45267-02 
.45166-02 
.44107-02 
.42434-02 
•40016-02 
•37041-02 
•33619-02 
.29562-02 
.25006-02 
•21006-02 
•17740-02 
.13009-02 
•10133-02 
.60399*03 
.40543-03 
.19002-03 
,54669-04 
•00000 


m 

1,5', 
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V.  EXPERIMENTAL  investigation 
OF  OVERLAP  EFFECTS 


An  experiment  tea 

1^11 


to  study  tbs  offset  of  overlap  of  date  on 
the  estimate  |  *.  The  analytical  results  presented  earlier  relate  only  to  the 

sgments  (that  is,  the  ease  of  aero  percent  overlap).  This 
the  effect  of  different  amounts  of  overlap  on  bias  and 


that  the  application  of  nooawerlapplng  weighting  func- 


ii?lJ 


intuitively,  it 


<yl*  • 


tlon  does  not  maho  the  best  use  of  the  date  when  forming  the  estimator  |  7  (I 
This  lnsffilcianey  is  similar  to  the  wastage  in  forming  auto  power  spectral 
density  ftmctlona  shown  by  Nuttell.  ^  When  1 7  (^)  |  is  formed  without  over¬ 
lap,  larger  bias  and  larger  variance  result  than  whan  ,|’v  (f^)  |2  is  formed  from 
the  — "«•  date  with  overlap.  Because  this  inefficiency  can  not  be  permitted  in 
many  practical  situations  of  Interest  (for  example,  underwater  acoustic  environ¬ 
ments),  it  is  desirable  to  know  how  much  the  bias  and  variance  can  be  reduced 
and  at  what  expense  this  reduction  can  be  achieved. 


V.  A.  METHOD 


The  method  of  achieving  the  desired  objective  is  straightforward  in  concept 
Date  are  generated  with  an  accurately  prespecified  value  of  magnitude- squared 
cohere r.cs,  |  y  2  ,  which  is  Independent  of  frequency,  f .  Since  the  date 


66 


TR  4343 


have  been  generated  so  that  tha  magnitude-squared  coherence  is  independent  of 
frequency,  the  sample  mean  and  variance  of  |  >i  2  can  be  empirically  deter¬ 
mined  for  the  given  overlap  by  averaging  over  frequency.  These  data  can  then 
be  reprocessed  at  several  different  overlaps  to  form  estimates  of  bias  and 
variance. 


V.A.l.  Data  Generation 

Consider  the  zero-mean,  wide- sense  stationary,  Gaussian  waveforms 
n^(t)  and  n^ft)  that  are  statistically  independent  and  have  power  spectral 
density  functions  $  (f)  and  $  (f) ,  respectively.  Statistical  independence 

Vl  V 2 

dictates  that  they  be  uncorrelated;  that  is, 

Rn  n  (r,“E  [“jW  »2<*+  *>J  -0  .  (6.1, 

In  order  to  generate  two  processes  with  magnitude- squared  coherence 
independent  of  frequency,  let  (Nuttall  and  Carter31) 


x(t>  -  n1<t,  ♦  On2(t) 


(5.2) 


and 


y(t)  -  n2(t)  ♦  Gnl(t)  . 


(5.3) 


The  cross-correlation  of  x(t)  and  y(t)  is 


Expanding,  dropping  tanas  that  go  to  saro,  and  taking  the  Fourlar  t  ran  a  form  of 
Eq.  (5.4)  yields 


m+a*  (f) 
**  *1*1  *2*2 


(5.5) 


Tha  autocorralatlon  of  x(t)  la 


Rxx(r)  "  E  j  ["iw  +  0b2W]  [*l(t  *  r }  +  °*2(t  *  r }]  j  * 


(5.6) 


Expanding,  dropping  tarma  that  go  to  taro,  and  taking  tha  Fourlar  transform  of 
Eq.  (5.6)  yields 


11  2  2 


Similarly, 


A  (f)  -  ♦  (f)  +  G  $  (f)  . 

vyy  bj®2  *i*| 


Thus,  tha  magnltuda- squarad  coherence  between  x(t)  and  y(t)  la 


04^.0*  (f, 


[vr°VJ  K»®*o2v?] 


Now  introducing  tha  assumption  that  a  (f)  *  $  (f)  a  A  (0 

Vl  n2n2  "" 


(5.T) 


(5.8) 


(5.2) 
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(5.10) 


which  Is  Independent  of  froqueney. 

In  order  to  prespecify  a  desired  magnitude* squared  coherence,  1 1  d  | 2  , 
between  x(t)  and  y(t) ,  the  gain  O  of  Eqs.  (S.  2)  and  (5. 3)  must  be  selected 
by  solving  Eq.  (5.10): 


(5.11) 


Under  the  assumptions  made,  a  pres  pacified  desired  value  for  magnitude* 
squared  coherence  can  be  generated.  Bscauae  the  generated  proceaeee  will 
later  he  uaed  to  empirically  determine  a  very  small  quantity  (bias),  it  is 
important  that  the  generated  value  of  coherence  ta  indeed  the  desired  value.  In  the 
actual  generation  of  two  processes,  tbs  assumption  ft  „  (f)  *  ft  (f)  may  be 

Vl  Va 

violated;  therefore  it  becomes  important  to  determine  how  sensitive  Eq.  (5.10)  is 
to  this  ae sumption.  Consider  then 
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It  la  easily  shown  by  substituting  Eq.(5. 12)  Into  Eq.  (5. 9)  that  the  value 


of  magnitude- squared  coherence  generated,  \\  •  *• 


,  .2  2  1  ♦  A  » jA' 

gl  d  ...*ia2|.  |t  * 


n-A**A,|yd|: 


(5. 13) 


where  y.  j2  «  desired  value  of  |  T  | 

2 

,  and  the  dependence  of  f 

is  dropped 

for  convenience. 

The  error  In  the  generated  value  is 

1  1 2  t  |2  1  |2  /. 

i  A  *** 

(5.14) 

I»,l  -  I’d!  •  lTdl  (l* 

,d1*1 

Evsluattan  of  Eq.  <5. 14)  to  third  order  In  A  yields 

I’*!*  -  K|*  «  |»4|*(‘-  !»«!*)* 


(5. 15) 


This  quantity  Is  maximum  at  |  y  ^  ■  $  and,  hence,  the  maximum  error  is 


approximately 

Max  error  1 


A)  . 


(5.14) 


Therefore,  for  example,  when  A  ■  0.01,  the  maximum  error  is  apprax- 
-4 

innately  4  x  10  ;  for  A  *■  0.05  ,  the  maximum  error  is  approximately 

" ^  i  2  31 

1.5  x  10  .  (A  table  of  errors  versus  I  y  |  and  A.  as  computed  fn  m 

o  1 

tq.  <5.  14),  yields  results  similar  to  the  (iven  approximations  i 


The  proouMi  gnanlad  according  to  Eqa.  (5.  S)  and  (8. 3)  have  been 
shown  to  ba  relatively  Inaanaltln  to  minor  dtfiaraaoaa  la  Urn  power  spectral 
donalty  functions  of  tha  original  uacorralatad  wavaforma  a}  g)  and  n^ft)  . 

The  prooadnra  for  gaaarattag  vmrlahla  coharaaoa  tim*  aarlaa  caa  briefly 
ba  aummarisad  aa  follows:  One  Qanaalan  aolaa  source  uacorralatad  from 
point  to  point  was  need  to  generate  a  time-limited  aampla  function  of  s^)  and. 
later,  of  ^(t)  .  (This  method  ellmlaatea  the  aead  for  two  Identical  flltera. ) 

The  waveforms  were  bead- limited  using  a  low  pass  filter  sad  digitised.  The 
dgltal  data  were  than  stored  oa  magnetic  tape  la  a  format  niaapsHhls  with  over¬ 
lapped  prooeaslag.  Digital  varalone  of  aft)  »  a^g)  ♦  Ch^g)  and  yg)  •  n^g) 

♦  Oa^g)  were  gsnsratad  frees  digital  vo raises  of  ^g)  sad  afg)  for  two 
valaaa  of  |  | 1  .  (levs sttgs tine  for  athsr  vahme  of  tree  magnttada-sgaared 

c  char  sacs  appeared  to  he  aaneoeeeary. ) 

A  Hewlett  Pochard  Netae  Qaaerntor.  Medal  No.  KPS7SSA.  was  used  for 


dau  generation  with  the  following 


3  hits 

Onus  elan  ms  OS  x  3  IS  volts  (open  circuit) 

The  output  power  deaeity  fuactiea  Is  flat  to  wtthle  ♦  0  3  dH,  provided  the 
fluctuates  as  mere  than  j  it  pa  re  eat  This 
IS).  sfT.lUi  If"1  aad  i  m 
co he  rears .  (run  Iq.  (S  IS),  of  3  *  10  *  F«*r 
•  0  S000  oar  could  expect  0  SOOt  >  I  V 


Input 
to  a  A  .  la  Eg 
magnl 


error  la  tha 
-4 


mple  tf 


>  0  4hf*i  making  tt 


yt  4)43 


A 

Var  * 


Results  of  the  experiment  are  described  in  the  next  section. 


(5. 18) 


V.  B.  RESULTS 


Results  of  the  experiment  for  a  joint  set  of  data,  each  (32  x  409G)  samples 

Iona,  are  included  in  tabular  and  graphic  form.  Confidence  hands  for  the 

estimate*  of  Idas  can  be  determined  from  the  estimates  of  variance.  However, 

it  must  be  realized  that  1000  samples  (frequencies)  were  used  to  determine  the 

average,  and  that  each  sample  is  correlated  to  the  extent  of  approximately  0.5  with 

neighboring  estimates  (empirical  results).  This  agrees  with  analytical  results 

14 

provided  for  auto  spectral  estimates. 

R  Is  apparent  from  the  results  (Tables  6  :uut  7  and  Figs.  28  through  :» 1  > 
that  the  bias  and  variance  of  j  >  j 2  can  be  reduced  through  the  use  of  over¬ 
lapped  processing.  For  example,  when  |  y  J  2  *  0.0  ,  the  variance  of  the 
estimator  with  50-percent  overlap  equals  31  percent  of  the  variance  of  the 
estimator  with  0-percent  overlap.  With  50-percent  overlap,  the  bias  is  55  per¬ 
cent  as  large  as  with 0-percent  overlap.  Similarly,  when  |*y  |  2  *  0.3  ,  the 
variance  it  55  percent  of  the  0-percent  overlap  estimator,  and  the  bias  is 
50  percent  as  large.  It  also  esn  be  seen  from  the  results  that  62. 5-percent 
•n-rrlap  i*  similar  to  having  processed  twice  as  much  data  with  0-percent  over¬ 
lap.  There  is  one  possible  exception:  The  bias  for  |>  |  2  =  0.3  is  36  percent 


•  4 


*•  -4 


as  large  as  the  0-perrent  overlap  estimator.  This  is  better  than  50  percent, 


«Mf 


i 


MS 


0  10  2030403040  70  *0  90 

PCRCCNTAOC  OVCRLAP 

ris.  II.  VlriMM  of  |4|*  WlMB  l>lf-0.J  Md  0-31 


Quito  naturally,  than  la  an  iacraaaa  in  computational  coat  aaaociatod  with 


overlapped  prooaaalng.  Specifically,  tha  number  of  FFTa  to  be  performed 
(a  maaaure  of  the  oompufatlnaal  coat)  inereaaea  with  the  percent  overlap  apec- 
ifled  ( Fig.  St).  Tha  number  of  FFTa  required  for  50-percent  overlap  ta  ap¬ 
proximately  twice  tha  number  for  O-peroent  overlap. 

faoressing  the  overlap  from  SO  peroent  to  62. 5  percent,  requlrea  32-per- 
oent  more  FFTa,  but  the  variance  of  the  eatimator  becomea  only  80-95  percent 
of  ito  value  at  50- peroent  overlap.  In  moat  cases,  the  improvement  to  be 
derived  from  uatoc  •*.  5- peroent  overlap,  aa  oppoaed  to  50- percent  overlap, 
will  not  warrant  the  inereaaed  computational  Mata,  and  ebould  be  used  only 
whan  atrtofaat  variance  and  blaa  reduction  requirements  are  demanded. 


OF  FFT*  COMPUTED 
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VI.  C0WCLUB10M 

A  AWM  aitiftkal  ualjfiia  of  Mm  statistics  for  sot  lam  Hag  Mm  magaitude- 
•fooroM  edMCWM  tasttaa  (spantrsm)  has  booa  mod*,  fka  sueh  estimates 
in  mMdt,  than  llaaitod  snails  fuacMoas  of  loaf  duration,  which  oro  stationary 
(to  Mm  wide  ooaao)  ever  Mm  pariod  of  observation,  moot  bo  available.  Expree- 
ririM  for  tbo  probability  doaolty,  tbo  cumulative  dlotributioo,  aad  Mm  bias  and 
varlaaoo  of  |  'y  |  *  have  booa  proooatod  for  tbo  oaoo  wboro  no  overlap  process- 
tag  la  used.  Evaluation  of  tboao  oapraaaloaa,  which  ara  dopondont  oa  both  tbo 
traa  valae  of  ooharoaoa  and  tbo  aaasbar  of  obaorvad  aagasenta,  a,  dramatically 
portraya  tba  roqairoMoat  that  a  bo  large. 

Tbo  of  a  iinalaa  esltbtlf  function  la  ordor  to  roduoo  orrora  duo 


to  aldolobo  Int^i  waotoa  tba  available  data.  Aa  obowa  oaipIrleaUy,  propor 
ooo  of  tbo  data  la  torma  of  rodaood  Mac  and  varlaaoo  of  tbo  oatimator  eaa  bo 
achieved  through  overlapped  proeoaalng.  It  appoaro  that  a  62. 5- percent  over¬ 
lap  la  roughly  equivalent  to  having  twice  aa  much  data  available.  The  reduced 
biaa  aad  variance  of  tbo  eotlmator  achieved  through  62. 5-percent  overlapped 
prooeoalng  can  bo  realised  almoet  entirely  through  a  50-percent  overlap.  The 
computational  eoet  aaooolated  with  50-poroent  overlap  io  not  unreasonable. 
With  50-peroent  overlap,  varlaaoo  aad  bias  reductions  are  achieved  that  are 
similar  to  reductions  resulting  from  processing  twice  as  much  data  with  O-percent 
overlap.  This  significant  gain  to  be  obtained  from  50-percent  overlap  processing 


fj 


Using  M*  (A.  7)  nd  (A.  A)  yields 


'«*  M’  *(v  bl)1- 


»  ♦  T 


(A.  10) 


(A.  11) 


For  example,  coaeider  the  caee  |  >  |  *1.0,  Now  *>  0.0  ,  B^  »  0.0  , 
Kq.  (A.  11)  bold  with  equality.  Coo  alder  also  jyl-0.0.  Then 


r(n>  r<3/2) 

T(b  +  1/2) 


(A.  12) 


Using  Eq.  ft.  1.47)  of  Abramowltz  and  8tegun,2®  Eq.  (A.  12)  yields  for  large  n 
E(r*||B-  I7  I"0  0)*  -p-  -  i  y[77l  .  (A.  13) 

For  |  7 1  2  -  0  .  Eq.  (4. 21)  gives 

B  »-  ,  I  7  |  2  -  0.0  .  (A.  14) 

m 


Thus,  the  inequality  holds  and  Eq.  <A.  11)  becomes 


APPENDIX  B 


VATION  OF  A  SIMPLIFIED  EXPRESSION 
TOR  THE  EXPECTATION  OF  THE 
ESTIMATE  OF  MAGNITUDE- 

SQUARED  COHERENCE 


tat  dsrlvlnf  •  simplified  expression  for  e| 
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it  follows  that 


:(l?ls|n.M2).(i-M2)' 


00  (n)k  <b)k  I  T I  2  < 1  -  n> 

£ 


k*0  (b). 


k  ! 


£  %<n)k 


k»0  (n  +  1), 


-] 


(B.S) 


In  terms  of  F  functions,  Eq.  (B.S)  becomes 


:(I»I,|..|t|*)  b'  Oil’’!2) 


(1-  n) 


(B.  6) 


26 


Bv  using  Eq.  (15. 1. 8)  of  Abramowltz  and  Stegun,  Eq.  (B.6)  reduces  to 


(i?i2U  M2)-(i-M2)“  [(i-M2)’" 


(B.7) 


26 


Simplifying  and  applying  Eq.  (15. 3.3)  of  Abramowltz  and  Stegun,  Eq.  (B.  7) 
can  be  further  reduced  to 


(l?|2|».M^-l*- - -  (l-H2)  2F,  .  l;o  -  1 ;  )t  |  *)  . 


(B.S) 
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Fiaolly,  by  applytaf  Kq.  (15.2.8)  of  AbramowiU  ud  Stogua,  24  with  a  -  1, 
b  •  1 ,  ud  c  *  ■  ♦  1  ,  Xq.  (B.  8)  ou  bo  — ipolotod  into  tho  form 

*  (l^l1!  ••hi*)  ~  h  I2  ^(l.  1  i  n  +  2  ;  |  7  |  .  (B.  9) 
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Magnitude  Coherence 
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ABSTRACT 


Expressions  for  the  statistics  of  the  estimate  of  magnitude 
coherence  are  presented.  These  statistics  include  the 
probability  density  function,  the  cumulative  distribution  func¬ 
tion,  the  bias,  and  the  variance.  The  expressions  presented  are 
in  convenient  and  accurate  forms  for  digital  computer 
evaluation.  Tabular  and  graphical  examples  of  computing  bias 
and  variance  are  included.  Simple  approximations  are  also 
given  for  the  maximum  bias,  variance,  and  mean  square  error. 


Approve  lor  public  remote.  attribution  unlimited 


TM  No.  T011J-4G-72 


TABLE  OF  CONTENTS 

P»ge 


INTRODUCTION .  1 

STATISTICS  OF  THE  ESTIMATOR .  1 

COMPUTER  EVALUATION  .  4 

RESULTS . , .  4 

APPENDIX  A  -  FORTRAN  PROGRAM  FOR  F32  FUNCTION .  10 

APPENDIX  B  -  FORTRAN  PROGRAM  FOR  EVALUATING  THE  STATISTICS  .  .  11 

APPENDIX  C  -  TABULAR  RESULTS  FOR  THE  COMPUTER  PROGRAM  ...  17 

REFERENCES .  24 


i/ii 

REVERSE  BLANK 


TM  No.  TD1 13-48- 72 


INTRODUCTION 

Consider  two  wide-sense  stationary  random  processes  x(t) 
and  y(t)  with  auto  powar  apaetral  dansity  functions  Gx(f)  and 
Gy(f),  respectively,  and  cross  powar  spectrum  Gxy(f).  Tha 
magnitude-coherence  hatwaan  thasa  two  proeesses7is  dafinad  as 


Estiaates  of  |V(f)|  from  n  sagaants  (or  piecas)  of  data 
ara  frequently  made  according  to 


where  X*(f)  and  Y*(f)  are  tha  Fourier  coefficients' obtained 
by  perforaing  a  fast  Fourier  transform  (FFT)  of  the  ith 
weighted  segment.  Tha  problem  addressed  hare  is  the  behavior 
of  the  bias  and  variance  of' the  random  variable  |%(f)|. 

STATISTICS  OF  THE  ESTIMATOR 

There  has  been  much  related  past  work  on  statistics  of 
the  form  of  (2)  for  n  independent  segments  and  x(t)  and  y(t) 
Gaussian  zero-mean  processes  U-12] ,  ^In  particular,  the  prob¬ 
ability  density  function  (PDF)  of*  | £  I  can  be  found  in  refer¬ 
ences  2,  5,  and  10-12. 

4>(i*i|i*i;«o  =  isrylM- 

\*\x).  <3) 


•The  f  dependency  is  dropped  for  notational  simplicity. 
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is 


The  cumulative  distribution  is  given  by  [12): 

p(>ii| 

•f  (“ShfjiK—.'iWtw). 

K-o  7 

For  tho  spoeinl  east  of  |yl  ■  0, 

P(ut|  n  W\--o)  =  |-Cl-^r. 

Diffmntiation  yields  tho  result 


(4) 


(S) 


(l<l  |  r  .  (6) 

In  general,  for  arbitrary  1*1  ,  the  nth  moment  (Ref. 
12)  is  given  by 

e(nr|n,M>(. -wr 

.  ,f,  V*Mi  u\l) . 


(7) 


3 1  2 

An  exact  expression  for  the 


Mu  %  £('*'  |n>,’$l)  “  U\ 


(8) 


bias 


(9) 


2 
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variaiic*  •  £  (W)  ~  l*  (\*\) 


(10) 


&• 


variance 


-ft-KT  ,F,  Cl  •  VM 


1(11) 


An  appxoxiuation  for  tho  vorioneo  is  fivon  by  [6] 


vorioneo  ="  ~ —  (  I  *1^1*)  > 

h  ft 


(12) 


which  hos  o  peak  value  at  |)f|  ■  0  such  that 


naxinua  varianeo  ss 


I 


2  h 


(13) 


ho  neon  square  error  of  tho  uagnitude-coherence  estina- 


Tho 

tort | ®i ,  from  the  true  value  is 


neon  square  error  •  variance  *  [bias]2 


(14) 

(15) 


:  EOJi1)  ♦  W2-2t(^W  •  Cl«) 


Since  the  mean  square  error  is  always  greater  than  the  vari¬ 
ance,  it  follows  that  equation  (16)  is  an  upper  bound  on  the 
variance,  though  not  a  least  upper  bound. 


m 

ksHiaiK 
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COMPUTER  EVALUATION 

The  FORTRAN  computer  program  for  tho  P32  function  coded 
by  A.  H.  Nuttoll  is  included  in  Appendix  A.  The  FORTRAN  com¬ 
puter  program  for  evaluating  the  bias,  variance,  variance 
approximation,  mean  square  error,  and  So  points  is  included 
in  Appendix  >.  Tabular  results  are  given  in  Appendix  C. 

RESULTS 


The  tabular  results.  Appendix  C,  of  the  computer  evalua¬ 
tion  are  given  for  7  values  of  n  and  several  values  of  |g|  . 

In  particular,  n  •  4,  8,  16,  32,  64,  128,  256.  For  each  value 
of  n,  |y|  ranged  from  0,0, in  steps  of  0.02,  until  the  variance 
was  .01  of  its  (approximate)  peak  value. 


As  shown  in  the  tables,  the  bias  (Eq.  (9))  has  a  max¬ 
imum  value  at  |Y|  ■  0,  namely  (see  ref.  [12]), 

maximum  bias?  "]/tt /h  (17) 

for  large  n , 


Now  when  |¥j  •  0,  using  a  result  in  reference  [12]  and 

inspecting  tabular  results,  we  find  that  equation  (16)  yields 

» 

maximum  mean  square  error  ■  .  (18) 

The  appearance  of  a  local  maxima  in  the  mean  square  error 
for  n  ■  64  and  |)f|  ■  .2  remotely  suggests  that  equation  (18), 
while  true  for  the  practical  range  n  &  256,  might  not  hold  in 
the  limit  of  asymptotically  large  n.  Similarly,  an  inspec¬ 
tion  of  the  tabulated  variance  clearly  indicates  that  the 
peak  value  does  not  occur  at  |yj  ■  0  as  indicated  by  equation 
(12).  It  can  be  observed  (see  tables)  that  the  abscissa  value 
for  which  the  variance,  equation  (11),  is  a  maximum  changes 
with  n.  This  type  of  behavior  is  not  predicted  bv  equation 
(12). 


Plots  of  the  variance  versus  |"X  |  arc  provided  in  Fig.  1 
for  the  7  values  of  n.  It  can  readily  be  seen  in  this  figure 
that  the  abscissa  value  for  which  the  peak  value  of  variance 
occurs  changes  with  n. 

A  plot  of  the  variance  approximation,  together  with  the 
true  variance,  is  given  in  Fig.  2.  The  usefulness  of  the  var¬ 
iance  approximation,  which  can  be  determined  quantitatively 


c 

I 

•i 

■ 
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from  the  tables,  can  now  be  seen  qualitatively.  In  particu¬ 
lar,  one  can  conclude  that  equation  (12)  approximates  an 
upper  bound  on  equation  (11)  near  the  origin,  and  hence  equa¬ 
tion  (13)  acts  as  an  approximate  upper  bound  on  the  variance. 

Plots  of  bias  and  mean  square  error  are  given  in  Figs. 

3  and  4.  They  bear  out  the  observation  that  bias  and  mean 
square  error  are  maximum  for  |X|  ■  0. 
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.5204+00 

.5x76+00 

.5138+00 

.5U89+00 

.5029+00 

.4957+00 

«4o75+00 

.4/61+00 

•4o7b+00 

.4360+00 

.4+34+00 

.4296+00 

.4x48+00 

.0990+00 

. 0o21+0U 

.0o41+00 

,0+52+00 

.0252+00 

.0042+00 

•2o21+00 

.2590+00 

. 2 j49+00 

.2097+00 

. lo04+0U 

. I00U+OO 

. 1273+00 

.9/50-01 

.6v4b— 01 


VAR  APf> 
.6250-01 
•6245-01 
.6230-01 
.6205-01 
.6170-01 
.0 126-01 
•6071-01 
.6007-01 
.5934-01 
.5852-01 
.5760-01 
•5b60— 01 
. 5551—01 
.5434-01 
.5308-01 
•5176-Qi 
.5036-01 
.4689-01 
•  4/35-01 
.4575-01 
.4410-01 
.4239-01 
.4064-01 
.0885-01 
.0702-01 
.0516-01 
.0327-01 
.0136-01 
.2945-01 
.2752-01 
.2560-01 
.2369-01 
.2179-01 
.1991-01 
.1806-01 
•  lb26-0l 
.1450-01 
.1279-01 
.1115-01 
.9584-02 
.6100-02 
.0708-02 
.5417-02 
.4238-02 
.0181-02 
.2256-02 
. 1475-02 
.6468-03 
.3842-03 
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M 

I  1X1 

l© 

1  .0jg0 

lo 

*  »2u UO-OX 

16 

0  .4000-01 

lb 

4  .OUU0-0A 

lb 

0  * 6000— Ox 

lb 

©  *1000+00 

lb 

/  • l*o0+00 

lo 

n  *1400+00 

lb 

9  • lbuO+OO 

lb 

xO  * lttU0+00 

lb 

Al  *2uu0+00 

lb 

1*  • 22o0+00 

lb 

16  *24u0t>00 

16 

A 4  *2ou0+U0 

lo 

lb  *2800+00 

lo 

1©  *60uU+00 

lb 

1/  * 62o0+0C 

lb 

1©  *64uU+00 

lb 

19  • 6uo0+00 

16 

20  *6©o 0*00 

lo 

AO 

16 

lo 

lo 

lo 

lo 

lo 

lo 

lo 

lo 

16 

lo 

10 

lo 

lo 

lb 

10 

lo 

10 

lo 

lo 

lo 

lo 

lo 

lo 

lo 

lo 

lo 


,  1«.©4-Q1 

.1*70-01 
• 1*89— ul 
.1.319-01 
.1 609-0 1 
.1 *0«-ol 
. 1  ♦60-01 
,1j26-01 
. lotto-01 
• 1 040-01 
•i/Oo-01 
•  1  /b^-ol 
. lold-01 
•lobn-ol 
•lo67-oi 

•1910-01 

• 1*24—01 


.*266+00 
,2069+oo 
.1069400 
•1091400 
. 106o+00 
.1696+00 
.1201400 
.1141400 
.1062+00 
.9624-01 
.6420-01 
.7616-01 
•Ottttl-01 
.0226-01 
• bo62— 01 
• bl0l-01 
.4626-01 


21  .4UU040C 

22  *42u0400 
26  *4400400 
*4  .4OU04UP 
2b  .4600400 
2o  .b(JOU400 
2 f  >b2u0400 
26  »04u0*00 
29  *bou0400 

60  *bou0400 

61  *0000400 

62  *62u0400 
66  *64u0400 
34  *Ooo0400 
6b  *0600400 

6©  *7oU0400 
6/  *7200400 
6o  *7hoU400 
7©o0400 
7600400 
6000*00 
B*uU+00 
46  *64o0400 
44  *6ou0400 
©600400 
9000400 
92U0400 
94U0400 


.1926-01  .419/-01 
•1919-01  .6612-01 
•1902-01  .6466-01 
•lo7b-01  .6101-01 


. lu6v-01 
• 1 /9©— ol 
•l/4b-0l 
•  l-jtty— oi 
•lu26-01 
.loOb-01 


•2867-01 
•2b09-01 
•23/4-01 
•2lb9— 01 
.1962-01 
.1760-01 


.1*82-01  ,1612-01 
.1*06-01  , 1407-01 


69 

40 

4a 

42 


4b 

4o 

4/ 

46 


•  1  -»2  7-01 
.1*40-01 
.1x02-01 
• Iu7tt— 01 


•1614-01 

.1160-01 

•10bo-01 

.9414-02 


•9*2 /-02  .0344-02 
•9U77-02  • /60&-02 
•tt*6*-02  ,6466-02 
,/j97-02  ,0062-02 
•6b7b-02  ,4796-02 
•0/7©-02  ,40/o-02 
•0U06-02  ,6421-02 
.4260-02  ,2b2j-02 
,6^00-02. .22©0-02 
,2o94-02  .1800-02 


.2*62-02 
.1/27-02 
. i*6b-o2 


. A38*-U2 
• lOlu-02 
.  /009-06 


.6141-06  .4521-06 
.4/21-06  .2041-06 


49  *9©u0+00  .2176-03  .1119-06 


»7\SC 
. 6*j0«01 
.0* j0-01 
.4/44-01 
.41/6-01 
.3716-01 
.6647-01 
.3004-01 

.  2©c.b-0i 
•2o6U— 01 

.2017-01 
.2417-01 
.2646-01 
•  2*ot>-01 
.2*41-01 
.2204-01 
.21/1-01 
.21j7-01 
.2106-01 
•20u4-01 
•2022-01 
.19 /4— 01 
.  .1922-01 
• ltto4— 01 
•1601-01 
.1/66-01 
. lbo2— 01 
•1067-01 
.1000-01 
.1427-01 
.1644-01 
.1269-01 
.11/6-01 
. I0ob-01 
.99 9b-02 
.9161-02 
.62/6-02 
.74*6-02 
.6099-02 
•5793-0* 

• 0Ua4-02 
,42u6-02 
. 30u0— 02 
.2897-0* 

. 22o4-0* 
.17*6-02 
. 1*j0— 02 
.8146-03 
.47*2-06 
.21/6-06 


^<T 

,6673+00 

•6j61+0U 

•340b+00 
•6440+00 
.6497+00 
•6b6Q+00 
•3©29+00 
.6/03+00 
.6/76+00 
•6651+00 
.3*20+00 
.6966+00 
.4069+00 
.4085+00 
.4121+00 
.4146+00 
.4161+00 
.4164+00 
.4x06+00 
.4a67+00 
■4iU8+00 
.4069+00 
•4020+00 
. 3*62+00 
• 3©96+00 
•3©22+00 
.6/41+00 
. 6o02+00 
•3057+00 
.6450+00 
.3648+00 
.3*34+00 
.3114+00 
.2989+00 
•2606+00 
.2/22+00 
•2©80+00 
•2433+00 
•2*80+00 
•2122+00 
•1906+00 
.1/89+00 
. Iol4+00 
.  1*36+00 
. 1*47*00 
.1054+00 
.8660-01 
♦oolfl-Ol 
.4422-01 


</Af?  ftPf 
.6120-01 
.6123-01 
.6115-01 
*3103-01 
.3080-01 
.O0b3-0l 
.6036-01 

.6004-01 

.2967-01 

.*926-01 

•2H80-01 

.*830-01 

.*770-01 

.*717-01 

.2654-01 

.2088-01 

•2018-01 

.2444-01 

•2367-01 

.2288-01 

.*205-01 

.*120-01 

.*032-01 

.1942-01 

.1851-01 

.1/08-01 

.1663-01 

.1068-01 

.1472-01 

.1376-01 

.1280-01 

.1184-01 

.1089-01 

.9905-02 

.9032-02 

•©128-02 

.7248-02 

.©696-02 

.0076-02 

.4792-02 

•4000-02 

.6304-02 

.*708-02 

.*119-02 

.1090-02 

.1128-02 

.7373-06 

.4234-06 

.X921-03 
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3* 

1 

3* 

2 

3* 

3 

3* 
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3* 

6 

3* 

O 

3* 
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3* 

6 

3* 

9 

32 
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3* 

11 

3* 

12 

3* 

lj 

3* 

14 

3* 

15 

3* 

lo 

3* 

1/ 

3* 

16 

3* 

19 

3* 

20 

3* 

21 

3* 

22 

3* 

23 

3* 

24 

3* 

25 

32 

26 

3* 

27 

3* 

2b 

4* 

29 

3* 

30 

3* 

3* 

3* 

3* 

32 

33 

3* 

34 

3* 

35 

3* 

3o 

3* 

37 

3* 

3b 

3* 

59 

3* 

40 

32 

4* 

3* 

4* 

3* 

43 

3* 

44 

3* 

45 

32 

4u 

3* 

4/ 

3* 

40 

3* 

49 

ut-  1 

\>L\ 

•  OyoO 
•2uu0-Ul 
•4UU0-01 
•bUuO-Ox 

•buou-01 

•lOuO+OO 

•12U0+0C 

•  14 jO+OO 
• 16U0+00 


.OjIh-02  .1570+00 
.ojtt/-02  .1362+00 
.ojOI-02  . 1211+00 
.7141-02  .1050+00 
• 7 jHO-02  .9229-U1 
•6089-02  ,b044-Ui 
.Oo34-02  . /013-01 
, ViUt-02  .5122-01 
.9/04-02  .535/-U1 
•luly-01  .4703-01 


•4200+00 

•4400+00 

•4bU0+00 

•4OO0+00 


•2000+00  .1J57-01  .4145-01 
•22o0+00  .lo89-fJl  .3609-01 
•2400+00  . Iil2-0l  .0265-01 
•2o00+00  .1127-01  ,291o-01 
.2600+00  .1*53-01  .261 /-Ol 
•3Uu0+0U  .1*31-01  .2359-01 
•32U0+00  .1*22-01  .2134-01 

•  5401) +00  .1106-01  .193o-0l 
•3O00+00  • 1067-01  .1/61-01 

•  36O0-+00  .1063-01  .1604-01 
.1054-01  .1464-01 
.1003-01  .1330-01 
•9u81— 02  .1220-01 
.9513-02  ,1113-01 
.8/25-02  .1013-01 

-  .6320-02  ,9245-02 

•32U0+00  .6102-02  .8405-02 

•  541)0  +  00  ./o7*-02  ,/62o-02 

•  5ou0+00  .7«_3h-u2  .6901—02 
•5600+00  .6/89-02  .6227-02 
•6OU0+00  .0^59-02  ,5596-02 
•b2o0+00  ..5o87-02  .3013-02 
1 54y O  +  OO  .3+35-02  .4467-02 
>6oo0+00  .4^85-02  .3960-02 
obuO+OO  .4339-02  ,54bo-02 
7UUO+00  .4*00-02  .5051-02 
72U0  +  00  . 3v»69— 02  ,*o4/-U2 
/4o0+00  .3*49-02  .*2/4-02 
/ooO+OO  .2o42-02  .1931-02 
Veuo+OO  . 2'+52-02  .  l61o-U2 
bUOO+OO  .2079-02  .1555-02 
82UO+00  .1/26-02  .1079-02 
0400+00  .l»0l-02  .3514-03 
OouO+OO  .1*00-02  .6511-05 
bouO+OO  .6*89-03  .4//9-U5 
VOUU+0U  .5/04-03  ,3513-05 
92O0+00  ,3o79-05  .211  /-05 
94y0+00  .2*45-05  ,11oh-U5 
9buO+UO  .103o-05  .5115-0+ 


.3125-01 
.25/0-01 
.2147-01 
.1634-01 
•  lull)— 01 

• 1456-01 

.1535-01 
.1295-01 
.1237-01 
.1239-01 
.1229-01 
.1224-01 
.1219-01 
.1*12-01 
.1201-01 
• lio7-01 
• llu6— Ui 
.1145-01 
.1H6-01 
.1039-01 
. 1036-Ul 
.102U-01 
.9630-02 
.9437-02 
.9026-02 
.8606-02 
.61/5-02 
.7/31-02 
•7*o2-U* 
.6626-02 
.63/1-02 
. 5912-02 

•  5435-0* 
.5001-02 
.4331-02 
.4109-02 
.  5i>  /o— O2 

•  52 j4— U2 
.2646-02 
.2434-02 
.20ol-0* 

. 1 /*9— 02 
. 1401-02 
. 11U0-02 

•  6*91  —  03 
.5903-03 
• 3rtoU-U j 
.2*43-03 
. 1036-03 


*2<T 

.2421+00 
.2455+00 
.2474+00 
.2935+00 
.2612+00 
.2698+00 
.2/68+00 
.2675+00 
.2955+00 
.3U26+00 
.5085+00 
.5131+00 
.3164+00 
.3185+00 
.3193+00 
.5191+00 
.31 7H+0U 
.3157+00 
.5128+00 
.5093+00 
.3051+00 
.3004+00 
.2932+00 
•2o95+00 
.2u54+00 
.2/69+00 
.2700+00 
•2o28+U0 
.25^2+00 
.2472+00 
.2^89+00 
.2302+00 
.2212+00 
.2118+00 
.2021+00 
.  1921+00 
. lo*  T  +  00 
.1/10+00 
. 1599+00 
. 1405+00 
. I368+OO 

•  1247+00 
.1123+00 
.9950-01 

•  6o3  /-Oi 
.7*90-01 

.5409-01 
. 4495-01 
.3055-01 


VAR  APP 
.1563-01 
.1561-01 
.1558-01 
.1551-01 
.1543-01 
.1531-01 
.1518-01 
.1502-01 
.1484-01 
.1463-01 
.  1440-01 
.1415-01 
.1360-01 
.1338-01 
.1327-01 
.1294-01 
.1259-01 
.1222-01 
.1184-01 
.1144-01 
.1102-01 
.1060-01 
.1016-01 
.9712-02 
.9254-02 
.6789-02 
.6317-02 
.7841-02 
.7362-02 
.6881-02 
.6400-02 
.3921-02 
.5446-02 
.4477-02 
.4516-02 
.4U64-02 
.3624-02 
.3198-02 
.*788-02 
.*396-02 
.2 025-02 
.1077-02 
.1354-02 
.1060-02 
. /932-U3 
. 3o4 1-03 
• 3o66-03 
.*117-05 
.9604-04 
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H 

X 
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04 

X 
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04 

C 

•2000-01 

o4 

3 

•4Uu0-0i 

64 

** 

•oooO-Ox 

04 

5 

.ttUuO-Oi 

04 

O 

* IOuO+OO 

04 

/ 
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04 

6 
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04 

9 
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o4 

*» 

.1800+00 

04 

lx 

•2OU0+00 

04 

*2 

•2260+00 

04 

ij 

*2400+00 

04 

14 

•2O00+00 

04 

XJ 

«2o00+00 

04 

lu 

*3ooUf00 

64 

1/ 

*3260+00 

04 

16 

*34oO+00 

04 

19 

*  3ouU+G0 

64 

2y 

*3uu0+00 

04 

2i 

•4OO0+00 

04 

22 

•42U0+00 

64 

2j 

.4400+00 

04 

24 

•46u0+00 

64 

25 

.4660+00 

64 

20 

.5000+00 

64 

27 

•5200+00 

64 

28 

•5460+00 

OH 

29 

•boOO+OC 

04 

30 

*5800+00 

04 

31 

• 6060+00 

64 

32 

*6200+00 

64 

33 

•0460+00 

64 

34 

•60OO+OU 

b4 

35 

•ObuO+OO 

64 

3o 

• 7ouU+00 

04 

37 

*  7260+00 

64 

38 

* /4u0+00 

64 

39 

*  7oo0+09 

64 

4U 

*7860+00 

64 

41 

•8060+00 

04 

42 

*8260+00 

64 

•O 

•8460+00 

04 

44 

.60OO+OO 

64 

46 

*6660+00 

64 

4c 

•9060+00 

04 

4/ 

•9200+00 

04 

46 

*9460+00 

64 

49 

»9o60+00 

Oh 

1  Abut 

.3^05-02  .1110+00 
.3o84-o2  .9236-01 
.3^09-02  .7646-01 
.3*46-02  .6315-01 
.4j59-02  .5217-01 
.4793-02  .4327-01 
.620<j-02  .3613-01 
.b^7i-02  .304o-01 
,  Ov>6h-o2  .2697-01 
,6u7y-o2  .2240-01 
,6220-02  . 19b4-01 
.0293-02  .1723-01 
.bjl0-02  • ib33— Ui 
.6280-02  .1374-01 
•  o<-14-02  ,123o-01 
.6x19-02  .1122-01 
.6000-02  .1020-01 
.bu62-02  .9290-02 
•5/06-02  .046 0-02 
,bj40-02  ,77bij-02 
,bj60-02  .7087-02 
,5x70-02  .6461-02 
.4 >72—02  .b92o-02 
,4/68-02  .b4l4-02 
,4ob2-02  .4942-02 
,4^34-02  .4804-02 
,4x10-02  .4097-02 
,  3o83-02  .3710-02 
,3ub3-02  .3366-02 
,3421-02  .3037-02 
,3x87-02  ,2731-02 
,29b4-02  , 2446-02 
,2/22-02  .2179-02 
,2492-02  .19OX-02 
2268-02  ,1701-02 
2042-02  ,1467-02 
1o24-02  ,1290-02 
lul2-02  .1106-02 
1406-02  .9408-03 
1212-02  .7879-03 
1026-02  .0494-03 
8ulb-03  .6247-03 
0691-03  ,4137-03 
6403-03  .3161-03 
4668-03  .2317-03 
2o93-03  ,1603-03 
1696-03  .1020-03 
lxQj-03  ,8632-04 
bx8O-04  .2313-04 


fftsE-  3<r 

,lbo3-01  .1/26+00 
.1192-01  .1/46+00 
.9468-02  .lo02+00 
.7936-02  .lo8b+00 
.70ol-02  .1981+00 
•6bob-02  .2077+00 
.66x3-02  .2x66+00 
•6499-02  .2&39+00 
.6638-02  ,2297+00 
.6661-02  ,2339+00 
.6601-02  ,2366+00 
.6690-02  ,2380+00 
.6646-02  ,2383+00 
.6409-02  .2377+00 
.6308-02  .2365+00 
.6246-02  .2347+00 
.6104-02  .2324+00 
.6948-02  .2297+00 
,67/9-02  .2266+00 
,5o00-02  ,2233+00 
,6410-02  .2x96+00 
,6212-02  .2x67+00 
,6007-02  .2H6+.00 
,4795-02  ,2071+00 
,4577-02  .2024+00 
,4364-02  .1975+00 
,4127-02  .1923+00 
,3897-02  , lo69+00 
,3004-02  ,1613+00 
,3430-02  .1755+00 
-3195-02  .1094+00 
,29u0-02  .1031+00 
27c7-02  . lo65+00 
,2490-02  ,1498+00 
2208-02  .1428+00 
20+4-02  ,1356+00 
1626-02  ,1281+00 
lol4-02  .1205+00 
1409-02  .1126+00 
1213-02  .1045+00 
1027-02  ,9oll-0l 
8618-03  .8754-01 
6693-03  ,7o75-01 
5404-03  ,6973-01 
4Qob— 03  ,6049-01 
2693-03  ,6102-01 
1698-03  .4x33-01 
1103-03  ,3ib0-0l 
5168-04  ,2161-01 


VW  App 

.7813-02 
.7806-02 
. 7788-02 
.7756-02 
.7713-02 
•7 657-02 
.7589-02 
.7509-02 
.  7418-02 
.7314-02 
.  7200-02 
.7075-02 
.0938-02 
.0792-02 
.0636—02 
.6470-02 
.b294-02 
•Oil 1-02 
.5919-02 
.5719-02 
.5612-02 
.6299-02 
.5080-02 
.4856-02 
.4627-02 
.4395-02 
.4159-02 
.3921-02 
.3681-02 
.3440-02 
.3200-02 
.2961-02 
.2723-02 
.2489-02 
.2258-02 
.2032-02 
.1012-02 
.1599-02 
.1394-02 
.1198-02 
.1012-02 
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I.  INTRODUCTION 

The  purpose  of  this  memorandum  is  to  define  a  new  function,  the  smoothed 
coherence  transform  (SCOT),  and  to  point  out  its  utility.  Also,  its  shortcomings 
and  examples  of  its  estimation  are  included  for  completeness. 


II.  DEFINITION 

The  SCOT  is  the  smoothed  Fourier  transform  of  the  complex  coherence  function. 
Consider  two  stationary  random  processes  x(t)  and  y(t)  with  auto  spectra  G  (f) 
and  G  (f),  respectively,  and  cross  spectrum  G  (f).  The  complex  coherence  x  function 
7^(f )  between  the  two  processes  is  defined  as 

G  (f) 

w  “  -j 


The  smoothed  coherence  transform  is  defined  by: 

C(*) 


X 


W(f)  16  (f)  exp(}2#f  )  df 

oc 


where 


W(f)  is  a  smooth  weighting  function  (window)  such  as  a  cosine 
(Hanning)  bell. 


Estimates  of  Y(f)  from  r>  segments  (or  pieces)  of  data  are  frequently  made 
according  to 


t 


ilvflM 

i  I  i  -  I 


z 


,  0<  N -/ 
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where  X.(K)  and  Y.(K)  are  the  Fourier  coefficients  at  discrete  frequency  K, 
obtained  by  computing  the  P  point  discrete  Fourier  transform  (DFT)  [2}  of  the 
i-th  weighted  segment.  Proper  computation  of  i  (K)  requires:  (1)  that  a  smooth 
weighting  function  be  applied  to  each  segment,  (2)  that  each  segment  be  of 
sufficient  length  to  ensure  proper  frequency  resolution, and  (3)  that  the  number  of 
segments,  n  ,  be  large  in  order  to  reduce  the  bias  and  variance  of  the  estimator  [33  . 

Estimates  of  the  SCOT  can  now  be  obtained  by  computing  the  inverse  DFT  vio 
the  fast  Fourier  transform,  FFT  [43 

N-l 

C{e)  =  W(K^(fc.\expGj2-irKP/N) 

where  W(K)  are  discrete  samples  of  the  smooth  weighting  function  W(f). 


III.  DISCUSSION 

The  SCOT  is  an  ad  hoc  technique  discovered  by  the  authors  and  believed  to 
be  new.  The  specific  problem  which  prompted  its  computation  was  an  attempt  to 
determine  time  delays  between  weak  broadband  correlated  noises  received  at  two 
sensors.  A  related  problem  was  discussed  by  Roth  [5},  who  suggested  utilization 
of  the  "  impulse  response*  function  defined  by 


Under  certain  conditions  (or  models),  h('fc)  has  better  time  resolution  than  the  cross 
correlation  function  defined  by 

r-Oo 

R(V)  (f)  , 

~  Oo 


Examples  of  this  attribute  are  given  by  Roth.  The  rationale  for  dividing  the  cross 
spectrum  by  the  auto  spectrum  of  the  x(t)  process,  G  (f),  is  that  it  has  meaning 
when  x(t)  is  the  input  to  a  linear  system.  When  there Xis  no  such  physical  interpretation, 
however,  there  is  no  justification  for  normalizing  by  G  (f)  and  one  might  be  puzzled 
as  to  whether  to  "  whiten"  the  cross  spectrum  by  dividing  by  the  auto  spectrum  of  the 
y(t)  process,  G  (f).  A  technique  which  favors  neither  G  (f)  nor  G  (f)  is  to  divide  by 
*JG  (f)G  (f).  ^  Of  interest  is  the  fact  that  in  the  special  case  whe^e  G  (f )  =  G  (f), 

thex  Fourier  transform  of  the  coherence  function  is  equivalent  to  the  "  impulse  response" 
defined  by  Roth. 

The  reasons  for  looking  at  the  SCOT  are  in  part  obvious.  Consider  a  cross 
spectrum  with  certain  dominant  frequency  components,  e.g. ,  the  presence  of  a 
60  Hz  component  20  d&  above  the  local  average  cross  spectrum.  The  Fourier  transform 
of  the  cross  spectrum  yields  a  cross  correlation  function  heavily  dominated  in  the  time 
domain  by  a  60  Hz  sine  wave.  Hence, it  is  difficult  to  measure  the  delays  due  to  weak 
components  in  other  bands  of  frequencies.  One  apparent  method  to  skirt  this  dilemma 
is  to  compute  the  Fourier  transform  of  the  cross  spectrum  only  over  a  limited  band  of 
frequencies.  Unfortunately  this  requires  a  great  deal  of  apriori  knowledge  about  the 
data.  Also  the  desired  component  may  be  broadband.  On  the  other  hand,  the 
whitening  process  of  dividing  by  -JG  (f)  G  (f}  insures  a  complex  function  which 
satisfies  the  relationship,  ^  Additionally,  if  the  two  processes  are 

uncorrelated,  the  coherence  is  zero,  and  if  they  are  linearly  related,  the  coherence 
is  unity  . 

Depending  on  the  model  (or  actual  physical  situation),  the  SCOT  can  be  a  useful 
analysis  tool.  Two  other  points  should  be  mode  at  this  time.  First,  both  real  physical 
data  (not  reported  here)  and  the  synthetic  data  studied  in  this  memorandum  have 
fortuitous! ybomeout  some  of  the  strong  assets  of  the  SCOT.  It  is,  however,  a  trivial 
task  to  synthesize  sample  functions  of  two  random  processes  in  which  the  SCOT  would 
be  extremely  misleading.  Hence  the  SCOT  and  cross  correlation  functions  should  be 
used  together  with  other  statistics,  prior  to  drawing  any  premature  conclusions.  A 
second  point  to  make  is  that  other  whitening  functions  can  be  useful.  One  of  them 
briefly  investigated  is  the  phase  transform  (PHAT)  defined  by 

m’  LlsSii  ■ 

The  PHAT  whitens  the  cross  spectrum  more  than  the  SCOT.  In  several  real  data  cases 
studied  by  the  author^ the  PHAT  and  SCOT  gave  similar  results.  It  is  possible  to  devise 
synthetic  cases  in  which  one  would  perform  better  than  the  other.  The  application  of 
a  weighting  function,  W(f),to  any  frequency  function  prior  to  performing  the  Fourier 
transform,  while  not  explicitedly  called  out,  is  useful  when  it  has  physical  meaning. 


Hence,  one  could  form  a  smoothed  PHAT  or  smoothed  impulse  response  as  easily  as 
the  PHAT  or  impulse  response. 


IV.  COMPUTATIONAL  CONSIDERATIONS 


The  most  significant  computational  consideration  affecting  the  estimation  of  the 
SCOT  is  the  estimation  of  the  auto  and  cross  spectral  density  functions  prior  to 
estimating  the  coherence  £  3]  . 


One  computational  trick  which  can  be  applied  in  order  to  reduce  computer 
running  time  is  described  by  Eby£6] .  If  the  P  point  sequences  x  and  y  are  both 
real,  then  the  discrete  Fourier  transform  (DFT)  of  x^  and  the  DFT  of  ^  can 
simultaneously  be  computed  by  performing  one  fast  Fourier  transform  (FFT)  C  and  4] 
of  the  complex  sequence  d  =  *  +  iy„  • 


If  we  denote  D(K)  as  the  DFT  of  d^then  (7,  pp  308-309] 
X(K)  =  1/2  [D(K)  +  D*  (J)] 


and  _ 

Y(K)  *  1/2}  [D(K)  -  D*  (J) 

Reference  to  the  frequency  J  refers  ta  the  negative  frequencies  which  are 
found  in  the  upper  half  of  the  DFT  output.  For  example,  with  the  Cooley-Tuckey 
subscripting  [4]  (namely,  0  to  P-l),the  P/2  +  1  subscripts  starting  with  0  and  ending 
with  P/2  denote  positive  frequencies  from  zero  to  the  Nyquist  frequency;  the  P/2 
subscripts  starting  with  P/2  and  ending  with  P-1  denote  negative.frequencies  from 
minus  Nyquist  almost  to  zero  frequency.  Hence, with  the  Cooley-Tukey  subscripting^], 
we  add  and  subtract  subscripted  output  from  the  FFT  according  to  the  following  table: 


Count  K  J  K  +  J 


1 

1 

P-1 

P 

2 

2 

P-2 

P 

. 

• 

• 

. 

P/2-1 

P/2-1 

P/2+1 

P 

P/2 

P/2 

P/2 

P 

Table  1.  Cooley-Tukey  Subscripting 
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The  dC  component  must  be  treated  separately.  Negative  frequencies  can  be 
neglected  since  the  power  spectral  density  function  of  real  random  processes  is 
symmetric  about  the  origin. 

Another  type  of  subscripting  is  that  employed  by  Singleton  ,  where  the  data 
sequence  (vector)  is  subscripted  from  1  to  P.  Now  the  combining  table  becomes: 


Count 


K  +  J 


P+2 


P+2 


P/2-1 

P/2 

P/2+2 

P+2 

P/2 

P+2 

Table  2 .  Singleton  Subscripting 

Again  the  dC  component  is  handled  separately.  Note  in  Table  1  that  J«P-K  and 
that  in  Table  2,  J  -  P  +  2  -  K. 

Let  us  now  denote  the  complex  vector  D(K)  as  follows  (using  either  Singleton 
or  Cooley-Tukey  notation) 

D(K)  =  M(K)  +  jB(K) 

D(J)  =  M(J)  +  jB(J)  . 

Consider 

X(K )X*(K)  =  1/2  (p(K)  +  D*(jT]  )/2  [d*(K)  +  D(J)}  • 

By  substitution  X(K)X*(K) 

-  1/4  \%A(K)  +  jB(K)  +  M(J)  -  jB(J)] 

.  Jm(K)  -  ]B(K)  +  M(J)  +  jB(J)J^ 


,Vj  » 


m m 


iVivy, 

•*>;  5*. 
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-  1/4  IjjMOC)  +  M(jJ  ♦  j  [b(K)  -  B(J)1  ] 

.  ^M(K)  -»-IAU)i  -  i  [B(K)  -  B(J)jTj 

-1/4  ^JM(K)  +  M(jf]  2+  [BOO  -  Buf)  2  j 

Similarly,  it  can  be  derived  that 

Y(K)Y*(K)  *  1/4  ^B(K)  +  B(J)}  2  +  [m(K)  -  M(J)]  2^ 

and  further  that 

R#^X(K)Y*(K)}  *  1/2  [m(K)B(J)  +  M(J)B(K)} 

and 

I  ^X(K)Y*(K)}  -  1/4  [m2(J)  +  B2(J)  -  M2(K)  -  B2(K)]  . 

Tha  validity  of  these  derivations  Has  boon  verified  by  programming  the  listed  equations 
and  executing  the  computer  algorithm  with  the  synthetic  data  described  in  Section  V 
of  this  memorandum. 

V.  EXAMPLE 

There  are  many  configurations  (or  models)  which  wilt  bear  out  the  usefulness 
of  the  SCOT.  For  the  purposes  of  illustrating  this  usefulness  it  is  only  necessary 
to  present  one  such  example.  From  this  example  it  can  be  seen  which  types  of 
random  processes  should  be  studied  by  SCOT  analysis.  Consider  now  the  following 
block  diagram  (Fig.  1 ). 
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Figure  1.  MODEL  OF  TWO  RANDOM  PROCESSES 

The  nolle  generators  we  broaeband  and  uncorrelated.  Hence,  x(t)  and  y(t) 
have  common  (or  correlated)  broadband  noise  and  sinusoids  plus  oncorrelated 
broadband  noise.  The  cross  correlation  coefficient  was  computed  and  plotted  in 
Figure  2. 

The  SCOT  was  computed  and  plotted  in  Figure  3.  Notice  the  relative  ease 
with  which  the  time  delay  of  the  broadband  component  can  be  determined  from 
the  SCOT  plot.  This  is  in  contrast  to  the  difficulty  encountered  in  the  cross 
correlation  coefficient  plot.  The  PHAT  plot,  Figure  4,  for  this  model  yields 
results  similar  to  the  SCOT. 

The  power  of  the  SCOT,  which  is  borne  out  by  the  above  example,  promises 
to  be  a  useful  new  tool  for  studying  random  processes. 
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Figure  4.  PHAT  OF  x(t)  WITH  y(») 


VI.  CONCLUSIONS 


The  SCOT  if  a  useful  od  hoc  toe  hr  i  quo  for  analysis  of  time  delay  characteristics 
between  two  random  processes.  Examples  of  its  power  have  been  included  together 
with  a  discussion  of  its  applications  and  limitations. 
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Coherence  Estimation  as  Affected 
by  Weighting  Functions  and 
Fast  Fourier  Transform  Size 


G.  C.  Carter 


ABSTRACT 


Given  two  wide-sense  stationary  random  processes,  the 
(complex)  coherence  function  is  the  (complex)  cross  power 
spectral  density  function  divided  by  the  square  root  of. the 
product  of  the  two  (real)  auto  power  spectral  density  functions. 

Estimation  of  the  magnitude  square  of  the  complex 
coherence  (MSC)  with  fast  Fourier  transform  (FFT)  processing 
is  investigated  for  synthetic  data.  The  procedure  used  is  to 
partition  the  given  finite  time  histories  into  n  segments.  Each 
segment,  consisting  of  P  data  points,  is  multiplied  by  a  smooth 
weighting  function  before  computing  the  FFT.  Cross  and  auto 
spectra  are  then  averaged  over  a  large  number  of  segments 
before  forming  the  coherence  ratio. 

It  is  demonstrated  that,  when  the  magnitude  of  the  first 
derivative  of  either  the  auto  spectrum  or  the  phase  of  the 
complex  coherence  is  large,  (1)  multiplication  by  a  weighting 
function  is  absolutely  necessary  and  (2)  P  must  be  large 
enough  to  ensure  sufficient  spectral  resolution.  While  these 
techniques  have  been  suggested  by  individuals  familiar  with 
spectral  estimation,  the  gross  bias  errors  encountered  in  the 
MSC  estimate  due  to  improper  (rectangular)  weighting  func¬ 
tions  and  poor  frequency  resolution  (small  FFT  size)  are  much 
more  serious  than  might  have  been  expected. 
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DEFINITION  OF  TERMS 


C(f)  real  part  of  ♦xy(f) 

DFT  discrete  Fourier  transform 

f  frequency 

fk  kth  discrete  frequency 

FFT  fast  Fourier  transform  (fast  method  of  computing  DFT) 
MSC  magnitude  squared  coherence,  |>(f)|2 

n  number  of  segments,  each  of  P  points 

P  number  of  data  points  in  each  FFT 

Q(f)  imaginary  part  of  4>xy(f) 

s  subscript  denoting  segment  number 

y  (f)  complex  coherence  function 

♦x(f)  auto  power  spectral  density  function  of  x  process 

4>y(f)  auto  power  spectral  density  function  of  y  process 

*xy(f)  cross  power  spectral  density  function  of  x  with  y 
V  for  all 

A  estimate 

*  complex  conjugation 
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COHERENCE  ESTIMATION  AS  AFFECTED  BY  WEIGHTING 
FUNCTIONS  AND  FAST  FOURIER  TRANSFORM  SIZE 

INTRODUCTION 

Given  two  wide-sense  stationary  random  processes,  the  (complex)  coherence 
function  is  a  reduced  form  of  the  (complex)  cross  and  (real)  auto  power  spectral 
density  functions.  The  magnitude  square  of  this  complex  function  possesses 
several  useful  attributes.  For  example,  it  always  lies  between  zero  and  one, 
and  is  zero  for  independent  or  uncorrelated  processes.  This  report  emphasizes 
the  magnitude  squared  coherence  (MSC)  and  its  estimate  when  the  true  function 
is  equal  to  unity. 

For  example,  the  MSC  can  be  used  to  determine  whether  a  linear  relation¬ 
ship  exists  between  two  random  processes,  hi  particular,  if  the  two  processes 
are  linearly  related,  then  the  MSC  is  identically  unity. 1  Hence,  when  a  good 
estimate  of  MSC  can  be  obtained,  it  is  a  useful  statistic  in  describing  twowide- 
sense  stationary  random  processes. 

The  estimation  procedure  is  straightforward  computationally;  however, 
interpretation  is  more  an  art  than  a  science.  Several  investigators  have  addressed 
the  problems  of  MSC  estimation;  for  example,  see  references  1  through  16. 

In  this  report,  the  effect  of  weighting  functions  and  FFT  size  in  MSC  estimation 
is  illustrated,  using  previously  simulated  signals  and  results  of  Carter  and 
Arnold. 15 

The  purpose  of  this  study  is  to  aid  experimenters  purchasing  and  using 
digital  spectrum  analyzers  for  field  measurements.  In  particular,  the  inability 
of  a  (hardware  or  software)  spectrum  analyzer  to  estimate  properly  the  MSC 
function  strongly  suggests  that  the  auto  and  cross  spectral  estimates  are  in 
error. 

THE  COHERENCE  FUNCTION 

The  coherence  function  is  a  normalized  (complex)  cross  spectral  density 
function.  Specifically,  given  two  wide  sense  stationary  processes  x(t)  and  y(t) 
with  auto  power  spectral  density  functions  <t>x(f)  and  ♦y(f).  respectively,  and 
complex  cross  spectral  density  function  +xy(f),  then  the  complex  coherence 
function  is  defined2  by 


The  MSC  can  be  used  to  measure  system  linearity,  as  will  be  proved. 
Consider  the  linear  system  with  input,  x(t),  impulse  response,  h(t),  and  out¬ 
put,  y(t).  Then  the  output,  y(t),  is  obtained  by  the  convolution  integral 

y(t)  =  f  h(r)x(t-r)dr  .  (3) 

—mm 

The  transfer  function  of  this  linear  filter  is  obtained  by  means  of  the  Fourier 
integral: 

H(f)  *  h(r)  e'i2wtTdr  .  (4) 

~—mm 

From  reference  2  it  is  known  that  the  transfer  function  can  be  expressed  in 
terms  of  the  (complex)  cross  spectrum  and  the  input  auto  spectrum.  In  particular, 

♦  (f) 

H(f)  ,  ♦  (f)  +  0  .  (5) 

-V  X 

Furthermore,  the  auto  spectrum  of  the  output  of  a  linear  filter  is  given2  by 

♦  (f)  =  H(f)  H*(f)  ♦  (f)  .  (6) 

y  ^ 

By  using  equations  (5)  and  (6)  it  can  be  shown ^  that 

i  . 

H(0  '  ♦y(f) 

Substituting  equations  (5)  and  (7)  into  equation  (2)  yields 


(7) 
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|y(f)|2»H(f)  —  =  1,  Vf  .  (8) 

m 

Thus,  for  the  assumption  that  the  system  is  linear,  we  have  J T  <f)  | 2  =  1,  for 
all  frequencies.  If  |ir(f)| 2  is  not  equal  to  unity,  then  either  the  observations  of 
x(t)  snd  y(t)  have  been  corrupted  fay  noise,  or  our  assumption  was  in  error  and 
the  system  is  nonlinear. 

This  could  be  expressed  as  a  theorem:  If  a  system  is  linear,  then  the  MSC 
between  the  input  and  output  is  unity. 


THE  COHERENCE  ESTIMATOR 


The  method  used  for  obtaining  good  MSC  estimates  is  the  Welch8-Haubrich5 
technique.  Briefly,  it  consists  of  obtaining  two  finite  time  series  from  the  random 
processes  being  investigated  and  segmenting  these  time  series  into  n  segments. 8 
The  n  segments  may  be  either  "overlapped"  or  "disjoint"  from  other  segments. 
Each  segment  comprises  P  data  points.  A  weighting  (or  windowing)  function  is 
then  applied  to  each  segment  and  the  fast  Fourier  transform  (FFT)  of  the  weighted 
P-point  sequence  is  performed.  The  Fourier  coefficients  for  the  sth  weighted 
segment  are  then  used  to  compute  the  auto  and  cross  spectral  estimates,  which 
are  then  averaged  over  all  n  segments.  The  MSC  is  finally  computed  from  a 
ratio  of  the  average  spectral  estimates.  (Note  that  for  real  data,  n  complex 
FFTs  must  be  computed,  each  of  size  P. ) 

Specifically,  let  $xs(4c)  denote  the  estimate  of  the  power  spectral  density 
(PSD)  function  at  the  kth  frequency,  ffc,  obtained  from  the  sth  weighted  segment 
of  size  P  of  the  stationary  random  process  x(t).  Similarly,  let  $ys(fk)  be  the 
estimate  of  die  PSD  function  of  the  stationary  random  process  y(t).  Also,  let 
C8(fk)  and  Qs(fk)  denote,  respectively,  the  real  (co-)  and  imaginary  (quad-) 
part  of  the  estimate  of  the  complex  cross  spectral  density  function  of  the  two 
processes.7  (A  detailed  explanation  of  these  estimates  is  given  in  reference  1. )  The 
estimate  of  the  MSC  function  is  given  by  references  1,  2,  15,  and  16  as  follows*. 


'  n 

+ 

n  1 

2 

.8^1 

ls*l 

J_ 

‘  n 

_s  =  1 

n 

£fvs  <fk> 
8  *  1 

(9) 
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where  n  la  the  number  of  weighted  segments  (overlapped  or  disjoint)  over  which 
the  individual  estimates  are  averaged. 

Because  the  M8C  estimator  is  the  ratio  of  random  variables,  it  is  impera¬ 
tive  Oat  good  spectral  estimates  of  C(f),  Q(f),  ♦x(f),  and  ♦y(f)  be  obtained. 
Random  fluctuations  and  bias  of  any  of  die  four  spectral  estimators  become 
significant  In  the  ratio  used  to  estimate  the  coherence  (unction.  The  theoretical 
results  dictating  that  n  be  large  are  given  in  references  1,  12,  and  16. 

THE  COMPUTER  STUDY 

A  digital  computer  program  was  written  to  implement  equation  (!)>.  (Docu¬ 
mentation,  currently  in  preparation,  is  partially  contained  in  references  1  and 
IS. )  Two  input  parameters  include  the  FFT  size  P  and  two  different  weighting 
functions  (rectangular  and  cosine).  The  FFT  was  coded  by  Singleton.  1° 

During  the  first  part  of  this  computer  study  the  effect  of  a  weighting  function 
was  investigated  by  processing  data  with  two  different  weightings.  When  aP-point 
sequence  is  multiplied  by  a  rectangular  weighting  function  (no  weighting),  the  true 
spectrum  is  convolved  with  the  sin  x/x  function.  Therefore,  each  FFT  alter 
centered  at  a  specific  frequency  sees  energy  not  only  from  the  band  about  that 
frequency,  but  also  from  power  which  leaks  from  frequency  bands  not  desired.  7 
Leakage  results  in  biased  estimators  fxsftt)'  *y«(fk>.  C,(fk),  and  Qa  (ffc). 
which  become  a  critical  factor  in  MSC  estimation  because  equation  (9)  is  a  ratio 
of  biased  estimators.  This  is  well  illustrated  in  the  cases  which  follow. 

An  example  of  how  this  leakage  problem  seriously  corrupts  the  MSC  estimate 
is  in  order.  Recall  from  the  earlier  derivation  that  the  MSC  between  the  input 
and  output  of  a  linear  filter  is  unity  for  all  frequencies.  To  illustrate  the  estima¬ 
tion  problem  when  poor  weighting  functions  are  used,  white  Gaussian  noise  (fiat 
spectrum)  was  filtered  by  the  second-order  linear  filter  specified  by  the  recur¬ 
sion  equation 

Yn  =  AYn_!  .  BYn_2  *  CX„  ,  (10) 

where 

A  *  1.  97330 

B  *  -0.  98202 

C  *  0.  00872  . 
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Figures  1  and  2  show  estimates  of  the  gain  aid  phase  characteristics  of 
sharp  filter.  The  true  MSC  is  unity  (i.  e. ,  100  percent).  The  estimate  of 
is  plotted  in  figure  3  as  a  function  of  frequency. 

The  data  segments  were  not  multiplied  by  a  weighting  function.  (This  is 
relent  to  saying  a  rectangular  weighting  function  was  used. )  The  FFT  aide 
"leakage"  problem7  corrupts  the  estimator.  Mote  by  studying  figure  3  that, 
though  the  true  value  of  coherence  is  100  percent,  file  MSC  estimator  fails 
to  attain  the  true  value.  This  result  dramatically  portrays  the  need  to  apply  a 
smooth  weighting  function. 

In  other  experiments,  the  data  from  this  sharp  filter  case  were  reprocessed 
with  no  weighting  function  applied  to  the  time  series,  but  with  higher  resolving 
power.  In  particular,  16  disjoint  segments  of  size  4096  (as  opposed  to  64  of 
1024)  were  processed.  Processing  with  higher  resolving  power  but  without  a 
weighting  function  still  yields  poor  results.  IS 
RELATIVE  POWER  SPECTRAL  DENSITY  0R) 


Figure  1.  Gain  Characteristics  of  Second-Order  Linear  Filter 
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Figure  2.  Phase  Characteristics  of  Second-Order  Linear  Filter 

The  data  from  the  sharp  filter  case  were  again  reprocessed  with  no  weighting 
function  applied  to  the  time  series  but  with  higher  resolving-  power  and  more 
averaging.  In  particular,  64  disjoint  segments  of  size  4096  were  processed.  In 
that  case,  the  estimator  began  to  stabilize  but  not  about  the  correct  answer. 15 

A  technique  for  reducing  the  bias  due  to  leakage  is  to  multiply  each  segment 
of  time  history  by  a  smooth  weighting  function.  The  frequency-domain  equivalent 
of  multiplying  each  segment  by  a  weighting  function  is  a  convolution  of  the  true 
spectrum  with  the  Fourier  transform  of  the  weighting  function.  Hence,  the 
weighting  function  should  be  judiciously  selected  in  order  that  the  true  spectrum 
be  least  distorted.  The  factors  affecting  the  selection  of  the  segment  length  and 
window  shape  of  the  sth  weighting  function  of  length  T  to  be  applied  to  Ttotal 
seconds  of  data  are  as  follows: 

•  w_(t)  should  be  relatively  easy  to  compute. 

•  Ttotal /T  should  be  large  in  order  that  the  amount  of  averaging  be  suf¬ 
ficient  to  reduce  the  bias  and  variance  of  the  spectral  estimates.  (This 
problem  is  studied  in  references  1,  12,  15,  and  16. ) 
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PERCENT  OF  MSC 
100  1 


Filter)  Using  P  *  1024  and  a  Rectangular  Weighting  Function 

•  d°  wg(t)/dtn  should  be  continuous  for  n>0,  1,  2, ....  up  to  some  rea¬ 
sonable  limit,  since  this  ensures  that  the  sidelobes  of  the  Fourier  trans¬ 
form  of  wg(t)  die  off  rapidly. 

•  The  Fourier  transform  of  wB(t)  should  also  be  narrow  in  the  main  lobe 
(narrower  than  the  finest  detail  of  the  true  spectral  density  matrix  of 
processes  x(t)  and  y(t).  Generally,  this  lobe  is  narrowed  by  increas¬ 
ing  T.) 

The  specific  selection  of  a  weighting  function  involves  a  number  of  trade¬ 
offs.  I2  A  commonly  used  weighting  (or  windowing)  function  is  the  cosine 
(Hanning)  function  defined  by 
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1/2  ^1  -  co«  -l)a^t  <  T+  (*-l)a  , 

0  ,  e  1m where. 


where  a  1*  a  function  of  the  overlap1-  such  that  for  a  ■  T  there  la  no  over¬ 
lapping  of  segments. 

As  an  illustration  of  the  tremendous  improvement  to  be  derived  from  the 
use  of  a  smooth  weighting  function,  the  data  generated  for  the  sharp  Alter  case 
were  reprocessed,  this  time  with  a  cosine  weighting  function  applied.  The  re¬ 
sultant  estimator  is  plotted  versus  frequency  in  figure  4.  Careful  study  of 
figures  3  and  4  dramatically  portrays  the  necessity  for  applying  a  good  weight¬ 
ing  function.  In  the  purchase  and  use  of  spectrum  analyzers  designed  to  estimate 
the  true  MSC  function,  it  is  incumbent  that  a  weighting  function  be  both  available 
and  used. 

During  the  second  part  of  this  computer  study  the  effect  of  the  FFT  size 
was  studied.  Cosine  weighting  functions  (verified  to  be  essential  during  the  first 
part  of  this  study)  were  used.  Good  frequency  resolution  requires  large  size 
FFTs.  Other  studies,  for  example  references  1,  12,  15,  and  16,  point  out  the 
requirement  that  a  large  number  of  FFTs  be  computed. 
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The  data  from  the  sharp  filter  case  were  reprocessed  with  smaller  size 
FFTs  (that  is,  poorer  frequency  resolution),  as  an  illustration  of  this  type  of 
bias.  The  resultant  MSC  estimates  are  plotted  in  figure  5.  Note  that  the  esti¬ 
mator  fails  in  the  frequency  band  where  the  estimation  procedure  has  poor 
resolving  power  relative  to  the  true  complex  coherence  spectrum.  As  shown, 
the  bias,  due  to  insufficient  FFT  size,  can  be  most  serious  when  estimating 
coherence.  This  behavior  of  the  MSC  estimator  was  predicted  by  Jenkins  and 
Watts.  4 

In  ether  experiments  the  same  data  from  the  sharp  filter  case  were  reproc¬ 
essed  with  256  disjoint  segments  of  size  1024.  The  results  were  the  same  as 
those  given  in  figure  5.  That  is  to  say,  the  bias  due  to  poor  resolution  can  not 
be  corrected  by  increased  averaging.  IS  However,  by  increasing  the  resolving 
power  and  processing  the  data  with  16  disjoint  segments  each  of  size  4096,  the 
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true  coherence  be  estimated  more  nearly  correctly  as  shown  earlier  In 
figure  4.  Increasing  the  resolving  power  can  improve  the  coherence  estimator, 
though  for  a  finite  time  history,  increasing  resolving  power  means  decreasing 
file  amount  of  possible  averaging.  In  this  example,  the  improvement  of  the  esti¬ 
mator  at  30  Hi  is  due  to  higher  resolving  power  of  the  detail  of  the  phase  of  the 
complex  coherence  function. 

In  order  to  understand  more  fully  this  resolution  problem,  another  case 
was  enHioH,  A  stationary  process  consisting  of  the  sum  of  white  Gaussian  noise 
•tiA  two  sinusoids  is  filtered  by  the  first-order  linear  filter  specified  by  the 
recursion  equation 

TYn-i 

Yn  * - + -  .  (12) 

8  8 

The  estimate  of  the  auto  spectrum  of  the  input  to  the  filter  is  given  in  figure 
6.  Similarly,  the  output  auto  spectrum  is  given  in  figure  7.  The  filter  specified 
in  equation  (12)  is  characterized  by  the  gain  and  phase  plots  of  figures  8  and  9, 
respectively.  The  estimate  of  MSC  is  given  in  figure  10. 

RELATIVE  POWER  SPECTRAL  DENSITY  <d») 

♦R0  1 


Figure  6.  Estimate  of  Input  Auto  Power  Spectrum  to  First-Order  Linear  Filter 


Fleur*  9.  Hum  Characteristics  ol  First-Order  Linear  Filter 
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Filter)  Using  P  =  1024  and  a  Cosine  Weighting  Function 
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The  input  sequence  was  generated  by  summing  noise  and  two  sine  waves 
(one  centered  in  an  FFT  frequency  bin,  one  out).  The  results  illustrate  the 
ability  to  estimate  MSC  when  the  phase  of  the  cross  spectrum  (which  is  the 
same  as  both  the  phase  of  the  filter  and  the  phase  of  the  complex  coherence) 
can  he  sufficiently  resolved.  The  bias  due  to  insufficient  resolving  power  has 
been  shown  to  be  directly  proportional  to  the  first  derivative  of  the  phase.  3 


Note  that  the  estimator,  having  resolved  the  true  coherence  of  100  percent, 
is  unbiased  and  has  zero  variance.  This  behavior  of  die  coherence  estimator 
was  predicted  by  Benignus, 6  Carter  and  Nuttall, 12  Carter,  1  and  Carter,  Knapp, 
and  Nuttall. 16  For  the  special  case  where  file  spectrum  of  the  input  to  the  first- 
order  filter  is  flat,  as  expected  file  coherence  estimator  is  100  percent  as  in 
figure  10. 15 


CONCLUSIONS 


Some  of  the  practical  aspects  of  estimating  the  MSC  function  have  been  pre¬ 
sented.  It  is  difficult  to  analyze  the  results;  two  points  which  must  be  considered 
are  weighting  functions  and  resolution.  First,  a  smooth  weighting  function  must 
be  applied  to  file  data  to  estimate  the  MSC  spectrum.  Second,  averaging  of  large 
size  FFTs  is  required,  dictating  time  series  of  long  duration  which  are  stationary 
over  the  period  of  observation.  Spectrum  analyzers  purchased  or  used  for  MSC 
estimation  must  have  weighting  functions  and  large  FFT  sizes  and  should  have 
phase  displays. 


Extracting  from  Tick, 3  "I  wonder  how  many  conclusions  have  been  drawn 
over  file  years  because  of  poor  estimation  procedures. " 
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ABSTRACT 


This  memorandum  discusses  a  digital  computer  technique 
for  estimation  of  the  power  spectral  density  matrix  between 
two  wide-sense  ergodic  random  processes  when  a  time- 
limited  member  function  of  each  process  is  available.  The 
digital  computer  algorithm,  including  the  FORTRAN  code,  is 
aiven  in  the  appendixes.  The  technique  is  based  upon  per¬ 
forming  a  partitioned  and  modified  Chirp  Z  transform  (PAM- 
CZp  on  each  channel  of  data,  using  the  computationally 
rapid  fast  Fourier  transform  (FFT).  The  technique  provides 
fine  frequency  resolution  in  a  frequency  band  of  interest 
despite  limited  computer  core  storage. 

A  complete  discussion  of  the  Chirp  Z  transform  and  the 
method  for  obtaining  finer  frequency  resolution  by  partition¬ 
ing  is  presented  together  with  an  example  case. 
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GLOSSARY 

fost  Fourier  transform 
Chirp  Z  transform 
Modified  CZT 

Partitioned  and  Modified  CZT 

basic  time  increment  between  time  samples 

frequency 

sampling  frequency 

frequency  resolution  in  Hz 

Time  duration  of  data  segment  in  seconds 

Hertz 

is  the  number  of  frequency  points  of  interest 

is  the  number  of  partitions  of  N  data  points 

Is  the  number  of  data  points  in  T  seconds 

Is  the  number  of  segments  or  pieces  each  of  size  N 

Spectral  density  function  of  x  with  y 

Transfer  Function 

Coherence  function 

Magnitude  of  c 

Angle  associated  with  c 


Multiplications  and  Additions 
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I.  INTRODUCTION 


A  technique  t«.  estimation  of  the  cross-power  spectral  density  matrix  between 
two  wide-sense  ergodic  processes  is  investigated  using  the  partitioned  modified 
Chirp  Z  transform  (PAM-CZT)  This  technique  has  received  little 

attention  to  date  due  to  the  lack  of  application  by  the  originators  [3,  page  90] . 
While  applications  of  the  PAM-CZT  may  not  be  apparent  when  dealing 
with  transients,  there  dearly  is  a  use  for  the  technique  when  dealing  with 
stationary  random  data  . 

The  second  order  probability  structure  of  the  zero-mean  stationary  random' 
processes  a(t)  and  b(t)  can,  in  general,  only  be  specified  with  knowledge  of 
the  k-th  and  |-th  joint  moment 


/WrjM)  -  £  V 

where  E  denotes  the  mathematical  expectation.  For  the  special  case  of 
k  »la  1,  we  have  the  cross  correlation  function 


The  Fourier  transform  of  R.  (*lr)  •*  given  by 

-  Qo 

A  partial  description,  then,  of  the  second  order  statistics  of  the  stationary 
processes  x(r)  and  y(t)  is  given  by  the  power  spectral  density  matrix. 


I = 


1 


where 


s(o 

S» (f) 

(1) 


(2) 


(3) 


(4) 


G  (f)  is  the  (real)  auto  power  spectral  density  function  of  x(t),  from  eq.  (3) 
when  **  a  *  b  ■  x, 

G  (f)  is  the  (real)  auto  power  spectral  density  function  of  y(t),  from  eq.  (3) 
when  ^  a*b“y,  and 

G  (f)  is  the  (complex)  cross  power  spectral  density  function  of  x(t)  and  y(t), 
(from  eq?^  (3)  when  a  *  x  and  b  *  y). 
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and  consists  of  a  raal  or  coincidental  (co)  spectrum  and  an  imaginary  or  quadrature 
(quad)  spectrum  (7] .  (G  (f)  h  ***•  comPlax  conjugate  of  G  (f). )  When 

these  two  processes  are  wid e-seme  stationary  and  Gaussian,  knowledge  of  the 
power  spectral  density  matrix  specifies  all  order  statistics  of  the  processes.  This 
is  fr+rm-e  the  density  function  for  Gaussian  processes  is  completely  known  from 
means,  variances,  and  correlation  coefficients.  It  is  for  these  reasons  that  study 
of  the  power  spectral  density  matrix  is  of  widespread  interest. 


In  obtaining  estimates  of  the  power  spectral  density  matrix  M  (f),  it  is 
incumbent  upon  the  investigator  to  sufficiently  resolve  the  true  detairof  the  spectrum. 
Severe  bias  and  variance  problems  can  result  when  the  true  spectral  matrix  has  not 
been  resolved  In  frequency.  For  example,  computation  of  the  coherence  from 
estimates  of  the  spectral  matrix  can  be  in  error  by  10  /o  or  more 
due  to  insufficient  resol  ut  Ion  [8^.  Fine  frequency  resolution. 


where  T  is  the  length  of  the  time  segment  to  be  transformed,  can  only  be  achieved 
when  T  is  large. 


The  concept  of  obtaining  fine  frequency  resolution,  using  a  fast  Fourier 
transform  (FFT)  was  introduced  by  Rabiner,  Schafer,  and  Rader  ^2-3^  .  The  technique 
is  called  the  Chirp  Z  transform  (CZT).  The  algorithm  has  been  studied  by  Schilling  , 
Ahmed C5l.  The  CZT  which  will  be  discussed  has  been  modified  so  that  only  frequency 
points  on  the  unit  circle  in  the  Z  plane  are  evaluated;  this  is  called  the  Modified 
CZT  (MCZT).  By  partitioning  the  input  sequence  to  evaluate  the  MCZT,  we  can  realize 
savings  In  transform  size  and  memory.  Utilization  of  the  partitioned  modifie 
chirp  Z  transform  (PAM-CZT)  allows  computation  of  1  large  size  FFT  via  several 
smaller  sTze  FFTs£6].  This  extremely  powerful  technique  for  stationary  data  is 


available  as  a  digital  computer  program  to  estimate  the  spectral  matrix  M  (f). 

xy 


II.  PARTITIONED  MODIFIED  CHIRP  Z  TRANSFORM 


The  Z  transform  is  given  by  [9j  : 


IU).  Z 


where  Xfn )  is  an  N  point  sequence  (of  T  seconds  duration) 
The  discrete  Fourier  transform  DFT  is  given  by  ^9^: 


r 


V-v  i» 
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■«».  . 


i  ViY.  -*■ 

iV.i' 

Yv. 
i  ,  V, . . 

'  !  v‘ 


V.  V|  V 


TM  No.  TC-5-73 


The  DFT  can  b«  aval ua tod  with  a  fast  algorithm  or  FFT.  It  can  be  seen  that  the 
DFT,  Eq.  (7),  evaluates  the  Z -transform  at  N  equally-spaced  points  around  the 
unit  circle  as  shown  in  Figure  1,  thus  obtaining  a  periodic  sequence  representation 
forXU). 


The  CZT  is  defined  by  [1  -  6]: 

H'l 


s  Z  w 

where 
and 


nk 


N-l 


(8) 


h=  o 

W  c  W0  n  $o  ) 

A  =  ex?  **  V 

Note  that  if  /\0  k/,  *ii>  that  Eq.  (8)  is  the  DFT,  Eq.  (7). 

By  the  inclusion  of  A.  and  W0  in  the  algorithm,  values  other  than  on  the  unit 
circle  are  attained.  That  is,  0#  defines  starting  frequency  and  A,  defines  the 
starting  amplitude.  The  value  <&u  defines  the  frequency  spacing  and  W0  defines 
the  spiraling  rate. 

We  now  modify  Eq.  (8)  such  that  W»-  I  and  Ao  =  I  and  define  the  modified 
CZT(MCZT)  0 


xlify  I 

*6i! 
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X  (k)  -  £  X(rs)  A 
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nk 


where 
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(9) 


A  *  exp 

W-  CXp  (  j  lir  ®») 

The  Z  plane  interpretation  of  the  MCZT  is  shown  in  Figure  2.  A  comparison  of 
figures  1  and  2  points  up  the  fact  that  the  MCZT  evaluates  a  limited  band  of  angular 
frequencies. 

Neither  Eq.  (8)  nor  Eq.  (9)  is  in  FFT  computational  form,  except  in  the  special 
case  where  1*1  *  N  •  Therefore,  for  the  general  case, we  are  forced  to  perform  the  DFT 
with  WA |  complex  multiplications  and  additions  required.  For  large  M  this  becomes 
prohibitive.  However,  by  making  the  substitution  suggested  by  Bluestein  [10],  we  obtain 


,k. 

L 

and  substituting  into  Eq.  (8)  ,  we  obtain 
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which  can  bo  simplified  to 


X(k)*  VJ 


0» 


h»o 


W  *  ®,  »,  .  •  }  ' 

ty  inspection  of  Eq.  (12),  we  recognize  that  it  is  in  the  form  of  a  convolution 
sum,  which  can  be  computed  via  FFT  techniques  of  Stock  ham  ^4}.  Therefore,  there 
ts  o  way  to  compute  Eq.  (9)  using  an  FFT. 

Using  the  method  outlined  by  Rabinor  [?1  and  Shilling  £4],  form  a  new  sequence 
defined  by 

-  (  «*V*  ) 

vm*w  ()3) 


Now  define 

!><«)  =  WnVt 

and  define  the  convolution 

<vU<)  »  "1  tU)  v(k-rx )  ,  k 

*  V»so 

Then  weighting  ^(k)  of  Eq.  (If)  by  W  allows  Eq. 


%(U*  <3(k)WkVz  J  k'O,  04) 

The  convolution,  Eq.  (15),  can  be  realized  by  computing  an  FFT  on  the 
sequences,  defined  by  Eqi.  (13)  and  (14),  multiplying  the  results, and  inverse  trans¬ 
forming.  In  order  to  nullify  the  advene  effects  of  circular  convolution,  the  FFT's 
performed  are  of  size  ft  +  rl-l  with  appropriate  zero  filling. 

Thus,  as  shown  in  Figure  3,  the  MCZT  algorithm  con  be  computed  by  performing 
two  FFT' s  and  the  inverse  FFT  with  appropriate  weighting.  Computationally  the  MCZT 
takes  3  FFTs  of  size  greater  than  N  .  It  should  be  noted  that  when  many  MCZT' s  are 
to  be  performed  on  different  input  data  sequences,  that  the  FFT  of  V(n)  should  be  computed 
once  and  stored.  It  this  step  is  taken, then  every  MCZT  perform  would  take  only  2  FFTs, 
resulting  in  a  substantial  savings  (33 /o)  in  computational  time&D.  (This  savings  in 
time  is  done  at  the  expense  of  having  to  store  the  transform  of  l/(o). ) 


-ojj...,**-!  (15) 

(9)  to  be  written  as 
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Partitioning  of  the  input  sequences  can  be  accomplished  so  as  to  reduce  the 
FFT  size.  For  example,  4  MCZT's  of  512  data  points  can  be  computed  in  lieu  of 
1  MCZT  of  2048  data  points.  This  partitioned  and  modified  CZT  (PAM-CZT) 
technique  is  extremely  powerful  and  is  discussed  in  the  next  paragraphs. 

The  modified  Chirp  Z-Transform  (MCZT).is  defined  by  Eq.  (9)  can  be  evaluated 
by  a  partitioning  technique.  Consider  the  situation  when  the  data  sequence  X^n), 

0  is  extremely  long  and  we  desire  M  spectral  samples  where  M<<N.  Then, 

throe  1 1 Ts  of  length  L  have  to  be  computed  with  the  MCZT  algorithm,  where  L  is 
the  smallest  highly  composite  value  greater  than  or  equal  to  (M+N-i).  In  such 
cases,  it  is  plausible  that  L  may  be  so  larqe  that  storage  requirements  prohibit 
computation  of  the  MCZT.  In  such  cases,  the  sum  in  Eq.  (16)  can  be  broken  up  into 
R  sums  over  the  N  points.  That  is,  the  original  data  sequence  is  divided  into  R 
partitions, and  hence  Eq.  (16)  can  be  written  as  follows  L2\: 


xo>- 


A  X  I 

where  RN  *  N.  Each  of  the  R  sums  in  the  brackets  can  then  be  evaluated  using  the 
MCZT  algorithm.  Eq.  (17)  is  referred  to  as  the  partitioned  MCZT  (PAM-CZT)  [6  ]  . 


(17) 


It  is  possible  that  a  saving  in  total  time  may  result  from  this  method  as  opposed 
to  evaluation  of  an  N  point  transform  [2  Hence,  the  PAM-CZT  can  be  expected  to 
perform  in  a  computationally  expeditious  manner.  Say, for  example,  M  ■  1024  s  2^® 
and  N  =  65,536  *  2  “  and  R  was  selected  R  *  64  s  2^. 

Then  the  brute  force  approach  requires 


=  2,a2,fc=  13L  =  k 


complex  multiplications  and 
additions  (MAD*  s). 
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The  FFT  would  toko 


Ik  a  /v 
=  3  *'*•  *  /° 


/>f/*0  : 


and  yield  all  the  coefficients,  provided  sufficient  core  memory  was  available  .  The 
PAM-CZT  would  take  (neglecting  the  FFT  on  ) 


J  ["•  rt  io3’  a  1 wW 
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for  power  of 
2  algorithms 
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so  if  brute  force  computations  required  30  minutes  in  this  case,  PAM-CZT  computations 
would  require  only  1  minute. 

lit.  POWER  SPECTRAL  DENSITY  MATRIX  ESTIMATION  PROCEDURE 

The  basic  objective  is  to  obtain  estimates  of  the  elements  of  the  spectral 
density  matrix. 


M„,  k>* 


<5,jo 

a 

S>"> 


In  order  to  characterize  the  second  order  statistics  of  the  two  processes  being 
investigated.  The  estimation  technique  described  is  the  direct  method  similar  to 
the  one  discussed  by  Haubrich  0  l],  Welch  021,  Knapp  03l,  Bingham  04],  Benignus  051, 
Nuttall  06  -  id.  Carter  08  -  193,  and  Bendat  [20l  except  that  it  uses  the  PAM-CZT 
in  lieu  of  the  FFT . 

In  this  Welch-Haubrich  technique,  the  time  series  are  segmented  into  P  pieces, 
each  having  N  -data  points.  For  example,  from  each  process  there  may  be  64  segments, 
each  segment  having  4096  points,  The  segments  may  be  overlapped  or  disjoint,  and  each 
segment  may  have  several  partitions.  Each  segment  must  be  multiplied  by  a  smooth 
weighting  function.  Next,  the  PAM-CZT  of  the  weighted  N-point  sequence  is  computed. 
The  M  Fourier  coefficients  for  each  weighted  piece  are  then  used  to  estimate  the  elements 
of  the  power  spectral  density  matrix  .  The  power  spectral  estimates  thus  obtained  from 
each  set  of  weighted  sequences  are  then  averaged  over  all  the  P  segments  (.18}  .  When 
N  is  selected  large  enough  to  insure  adequate  spectral  resolution  and  P  is  selected  large 
enough  to  reduce  the  variance  and  bias  of  the  spectral  estimators,  then  good  spectral 
estimates  are  obtained.  It  should  be  noted  that  the  selection  of  large  P  and  large  N 
are  conflicting  requirements  when  dealing  with  a  fixed  amount  of  data. 

The  method  of  overlapped  weighted  segmentation  requires  that  each  discrete 
N  point  segment(of  x(t)  and  y(t)  obtained  by  sampling  at  (Hz)  be  multiplied 
by  a  discrete  weighting,  W(M  • 


V\Vt>T 
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The  weighting  function  length  must  be  selected  so  that  its  Fourier  transform  is 
narrower  in  the  main  lobe  than  the  finest  detail  of  the  true  spectral  density  matrix  of 
processes  x(t)  and  y(t).  Generally,  this  lobe  is  narrowed  by  increasing  the  PAM-CZT 
size  Ol- 

The  specific  selection  of  a  weighting  function  involves  a  number  of  tradeoffs. 

A  commonly  used  weighting  (or  windowing)  function  is  the  cosine  (Hanning)  function 
defined  £l4j  by 


ww  *  i  ('  - 


V>  r  o,  | 

>  ) 


N-l 


(19) 


In  practice,  w  can  be  computed  once  and  stored  in  a  real  floating  point  array  of 
size  N  points.  Alternatively,  a  frequency  domain  convolution  can  be  performed. 


Let  x  (n)  where  n  =  0,  1,  2,  .  .  .  ,  N-l  denote  the  N-po?nt  sequence  obtained 
from  the  sth  weighted  segment  of  process  x(t).  in  estimating  spectra,  it  is  necessary  to 
evaluate  a  transformation  of  this  weighted  sequence.  The  PAM-CZT  is  a  fast  algorithm 
for  evaluating  the  Z  transform  of  the  weighted  sequence  x  (n)  ,  n  =  0,  1,  .  .  .  ,  N-l 
where  s  =  1,2, .  .  .  ,  P  at  M  equi-spaced  points  on  the  uniV  circle  with  arbitrary 
starting  frequency.  The  actual  computation  performed  on  each  segment  is 


Ups* 

Similarly,  a  (complex)  vector  Y  (k)  is  formed  for  each  piece  or  segment 
(that  is,  s  *  1,  2,  ...  ,  P).  * 

The  estimate  of  the  auto  power  spectral  density  function  of  x(t)  at  the  kth 
frequency,  obtained  from  averaging  sth  weighted  segment,  is  given  by 


Similarly, 


s,x(k)=  lx*(k)x*(k) ,  *t=7. 
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and  the  estimate  of  the  cross  power  spectral  density  function  is 

Equation  (23)  can  be  rewritten  in  terms  of  the  real  and  imaginary  parts, 
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and 
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*  6  (25) 

Tha  averaging  or  intagration  technique  utilized  here  reduces  the  variance 
of  all  four  spectral  estimators.  Additionally,  by  properly  averaging  the  real  (co) 
and  imaginary  (quad)  parts  of  the  cross  spectrum*  we  obtain  unbiased  estimates  of 
this  complex  function.  It  should  be  noted  that  this  type  of  averaging  is  invalid  if 
the  data  is  not  wide-sense  stationary,  for  in  that  case  the  correlation  matrix,  and 
hence  the  true  power  spectral  matrix  varies  from  time  segment  to  time  segment. 

That  Is,  averaging  Is  performed  to  reduce  random  fluctuations  in  the 
estimator;  It  is  not  performed  to  suppress  non  stationarities. 

A  useful  function  immediately  available  from  the  power  spectral  density  matrix 
is  the  (complex)  coherence  defined  by 
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Further,  when  x  is  the  input  to  a  linear  system  and  y  is  the  output  it  is  useful  to  discuss 
the  transfer  function  defined  by 


H(*J  * 

^ xx  (f )  (^) 

Estimation  of  these  quantities  is  performed  by  substituting  the  averaged  estimators  in 
place  of  the  true  quantities.  Statistics  of  these  quantities  is  beyond  the  scope  of  this 
report,  but  is  discussed  in  and [l8  -  20j  . 


IV.  COMPUTER  ALGORITHM 


The  fundamental  building  block  of  the  P  AM-CZT  is  the  fast  Fourier  transform 
(FFT)  rediscovered  by  Cooley  and  Tukey\.2ll .  The  selection  of  the  proper  FFT 
algorithm  involves  trade  offs  between  speed,  accuracy, flexibility, and  storage  of 
the  nature  discussed  by  Ferrie  [22^ .  The  mixed  radix  algorithm  proposed  (and  coded) 
by  Singleton  [i23l  is  appealing  because  of  its  speed  and  ability  to  compute  FFT' s 
when  the  FFT  size  is  not  a  power  of  two.  This  is  particularly  appealing  when 
l*  M+N-1  is  slightly  greater  than  a  power  of  two;  in  this  case;  to  resort  to  a  power 
of  two  algorithm  will  almost  double  the  computation  time.  For  example,  consider 
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65,536=  2* 6;  then  a  power  of  two  algorithm  will  require 
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whereas  Singleton's  routine  can  compute  an  FFT  of  size  75,000  and  will  require 
Llo^L.  =  7S,ooo  t  (1S“oo$ 

=  1. 3  >  |o4  ftftOs 

Hence, Singleton' s  algorithm  requires  approximately  half  the  MAD’s,  and  since  it  is 
already  the  fastest  routine  available,  it  provides  a  significant  savings  in  computational 
time. 


Singleton's  routine  is  not  without  drawbacks,  however.  In  particular,  it  suffers 
from  large  errors  due  to  round  oft  which  grow  rapidly  with  FFT  size,  unlike  other 
algorithms  [22 1.  A  recent  power  of  two  FFT  algorithm  (including  the  FORTRAN  code) 
is  given  by  Market  [24]  .  An  analysis  of  the  error  of  this  routine  was  done  in  reference 
[25J.  Because  Market's  FFT  algorithm  is  the  most  accurate  single  precision  technique 
investigated  to  date,  it  must  be  given  serious  consideration.  Selection  of  the  algorithm 
based  on  speed  and  flexibility  dictates  Singleton's  FFT.  On  the  other  hand, selection 
of  the  most  accurate  FFT  requires  picking  Market's  technique.  The  authors,  while 
using  both,  have  most  recently  been  concerned  with  accuracy  requirements  and  have 
leaned  towards  Merkel's  routine, which  is  currently  implemented  in  the  computer  program. 

V.  EXAMPLE  CASE 

An  example  case  is  enclosed  to  illustrate  some  of  the  program's  capabilities. 

White  Gaussian  noise  is  filtered  by  the  second  order  low  pass  digital  filter  specified 
by  the  recursion  equation  DO. 

s  A  ^(n-l)  4-6  )  4-  C  X  M 

where 

A  =  1.97330 
B  =  -0.98202 
C  =  0.00872 

The  block  diagram  for  the  example  case  is  depicted  in  figure  4.,  where  Z~* 
is  the  standard  delay  element. 
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The  figures  which  follow  art  estimates  of  the  spectral  characteristics  derived 
from  tht  sampled  timt  waveforms  X(*0  and  Y(l\)  in  tht  0  -  100  Hz  frequency  band 
by  utilization  of  computer  program  92178.  Figure  5  is  an  titimatt  of  tht  auto 
powtr  spectral  dtnsity  function  of  tht  X  proctss  (input  to  filftr).  Figurt  6  is  an 
tstimatt  of  tht  auto  powtr  sptctrd  dtnsity  function  of  tht  Y  process  obtained  from 
tht  output  of  tht  fiittr.  Figurt  7  is  an  tstimatt  of  tht  phast  of  tht  transftr  function 
btfwttn  tht  X  and  Y  proctssts.  Figurt  8  is  an  tstimatt  of  tht  gain  characteristics 
of  tht  probtd  system. 

For  the  sampling  frtqutncy  f  -  2048,  the  frtqutncy  resolution 

*  f*  /N 

was  varied  from  2  Hz  (when  N  *  1024)  to  0. 125  Hz  (when  N  *  16384).  Tht  resultant 
two  estimates  of  the  Magnitude  Squared  Coherence  (MSC)  art  given  in  figurt  9  for 
N  *  1024  and  figurt  10  for  N  *  16384.  Tht  true  MSC  between  the  input  and  output 
is  unity  at  all  frequencies  0&1  >  however,  when  estimating  the  MSQ  serious  bias 
errors  can  result  due  to  insufficient  resolution  (.8] .  This  type  of  bias  can  be  eliminated 
by  using  Program  S2178, which  allows  N  to  be  selected  as  large  as  desired  (consistent 
with  the  amount  of  available  data).  In  particular,  note  when  N  -  1 024,  there  is 
insufficient  resolution  and  the  estimate  of  MSC  is  biased  (i.e. ,  not  equal  to  the  true 
value);  however,  when  N  is  increased  to  16384,  sufficient  resolution  exists  and  the 
random  variable  is  properly  estimated. 

VI.  SUMMARY 

A  digital  computer  algorithm  to  estimate  the  power  spectral  density  matrix 
between  two  wide-sense  ergodic  random  processes  when  one  time-limited  member 
function  from  each  process  is  available.  The  algorithm  utilizes  the  Partitioned 
Modified  Chirp  Z  Transform  in  order  to  obtain  frequency  resolution  which  is  limited 
only  by  the  available  record  length.  This  added  digital  processing  flexibility  allows 
eay  circumvention  of  bias  due  to  insufficient  resolving  powet  as  shown  in  the 
example  presented.  The  FORTRAN  implementation  of  the  algorithm  is  given  in  the 
appendixes. 
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APPENDIX  A 


LISTING  OF  COMPUTER  PROGRAM  S2178 


HitoH  HE SOLUTION  tiAMOtl  RA«U  SPECTRAL  ANALYSIS  PR  OM«M  VIA  THE  ¥00  IF  TED 
PAKTUlONtw  CHIMP  A-TMA* *SA OMN  M*  v)«  CHANNEL  VERSION 


LAST  UPDATED  MARC*  IT.iVTj. 


TINE  DOHA It.  COSlMb  WINQOm  SPECTRAL  *HALTS1S  «1TH  So  PERCEN1  OVERLAP  OF 
INPUT  UaTA 


PnubMAHMEU  lil  J.F.pERRU  «  6.C.CARK-R 


OPERA TitA*  1NSIHUCT1'*;S  m  PAttTlTTONF.O  CHIRP  2  SPECTRAL  PROfcFAM  *  52116 
CARDS  «  ANu  I  *H*SI  BE  KwPCATEu  FOR  EACH  OATA  *Ar*L£ 

CaNU  C0LIA1NS  FORMAT  AROUMChT 


1-4* 

m6 

MI)  - 

T-«6 

10R6 

FNT  - 

67— uR 

PLmmK 

to-  n 

*2 

ICI  - 

72-/3 

RUm«K 

7R-/S 

i2 

NCMANL  - 

TO-rP 

15 

NCR  - 

I-S 

IS 

)#T  - 

6— AC 

IS 

1*1  - 

11-15 

AS 

NNN  - 

16— 4 1 

16 

aSR  - 

2t-«5 

1* 

ARF  - 

26-06 

A 1 

151  - 

«T-*T 

11 

152  - 

<0-26 

K*k<K 

fO-oO 

Al 

15*  - 

input  data  “Out  -  pumnic*  ocdfmt*  cocnch 
VAklAFU  FORMAT  FOR  SCO  DATA.  I.E.  (E1R.9) 


'EP^ER  OF  OCSIMCO  UATA  CHANNEL  STORFO  IN 
XX  ARRAY 


VUpMER  OF  OATA  CHANNELS  ON  COC  OR  RCD  OATA 

TAPE 

NUMoER  OF  CONVERSIONS  PER  RECORP  ON  COC  OR 
PCI  OATA  TAPE 

HUM4CR  OF  FILL  JESIMEO  ON  INPUT  DATA  TAPE 
fAMRER  OF  KECOKfl  Ob SI RED  ON  NFT  FILE  OF 

input  data  tape 

HUMMER  OF  I'#U1  VALUES  TO  SE  PROCESSED 
Ml  t  REM  SAMPLING  RATE 

MUMPER  OF  HGI6MTS  TO  THE  R10HT  OF  CENTER 
«EI*HT  DUR1N0  THE  USE  OF  SMOOTH  SUBROUTINE 
IT  15  APPLIED  IN  ThC  FREQUENCY  DOMAIN 
Cm.  TCP  ROM  MO  FPEQUCNCT  DOMAIN  SMOOTHING) 
DATs  OVERLAP  FLAQ  iSCTsI  FOR  NO  OVERLAP) 
*ll2MMf|N0  SWITCH  (SETSO)  FOR  VINOORIN6 


-  PRINT  FI A 9  (0  FOR  XtBO  OUTPUT) 


iwM 


m?}: 


,*• 

**tV, 


as: 


vm. 
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30*40 

31-40 

FlO.b 

SFX 

• 

SCALE  FACTOR  FON  FIRST  CHANNEL 

41-35 

bL*<«K 

Sl-72 

3AS«*4 

LAdEL 

• 

22  CHAnACTE't  TITLE  FOR  GRAPHS 

73— »0 

40 

ITdEC 

m 

TuTAL  NUMdEL  OF  records  to  be  processed 

ON  INPUT  OATA  TAPE 

1-15 

F15.5 

OF 

m 

fke* HJENCY  resolution  DESIRED  In  hertz 

U-«A 

ric.s 

FlO  ^ 

• 

LOWER  FREQUENCY  OF  INTEREST  IN  HERT7 

21-uO 

FI'J.5 

F*ldH 

• 

MluHER  FREQUENCY  OF  INTEREST  In  HERTZ 

31-41* 

140 

• 

HJ~e R  OF  PARTITIONS 

41-oP 

HLAiA 

1-oP 

t*L»<« 

SPECIFICATION  AMU  TYPE  STATEMENTS 

04MENSION  AX(40^>#YY(HC9b> 

DIMENSION  WXtWMl  »VY(«U9u)  tALIAOOfc)  » Yu (409b) 
0 iMENSlON  AX  C IMP  l I  *ZY  ( 1«/01 ) «PMIX ( Itivi ) 
DIMENSION  wCUCSS) 

OlfttNSlON  i?C«09o)»LINLU00) 

04MCNSIUJ  AKTtl?)  ’^ABElIIS)  tOUNMYU) 

DIMENSION  TITLE*  (b)  # TITLE. Y  (5) 

CmUIVALCNCcC IZ( 1 ) * VY C 1 1 1 
Cut* M)N  AMOURS (2*0) 

integer  fht 

OAT A  IuATE/« 031770*/ 


1N111ALUE  PnOGR*'-  U«ITS 

I*CARU33 

Ir'KNTKs* 

IN1APES7 


SET  iNIlIAt  ^ACUti 

CAU.  NTRANt INTAKE* 10) 
CALL  NTRANiINTAPC'221 

NrlLlNai 

NMtClNal 

LAbEL(A)s*sail6/* 
LANEL<4)3*lOOL  * 

La«MlL<  10)340  ATE 


INITIALIZE  FhOCHa  > 

4  bKITEi  1PRMR«2)L  A«^nL(3)  ••.AtoEL(Y)  #  it  'TE 

<  FUMMAT t 1H1//4A*  *Pt«uGRAM  *»a6»A6#'  L^ST  UPDATED  *.Ae,///» 
CAU.  M09ES«(A  >(XILStO) 

CALL  SLTSMuIAMO* XS*97»1C00.0) 
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SET  UP  OB  Ha.(6 £  AND  X»V  TJlLLS  Fgft  PLOTS 

CNMAXSIO.O 
3uNiNS-90.0 
TlfLEXmx*  FRtO* 

TllLCX<t>**UC*CV  • 

TITLCX<3)3' (Hi)  * 

T1 lc£T (l)S'DG//)  • 

T1 IlKYt 2)3* VOLT  S* 

riiLer(3is*o./iu  • 


ML  AO  *4UOE  OF  I?lpuT  LATA  F*0N  ’AT*  CARD  1 

RLALUuCAAl.IG)  Maw»(F*T(1»*  Ul.  10) .  ICl.  IC2'NCI«AM..><n 
10  F0^MTaiAo»3X»3U»IS) 

Ul*4 

LAtoLLt ll)3«Ct 
LM*Ml2)3iC2 


PNINI  INPUT  OATA  It»’uRM*rMu 

fcKlTC(IPRUIR.12>MiO» (FKl tl I • 1*1 » 10) t ICl. IC2.NCHANL.NCK 
U  F0HMAr<//0«»« INPUT  OATA  Mow t  *NO  Fo*MA| • ,/*X.llAA*3X.3I*.IS> 
CALL  NTRANtlNTAPE.AltllAPLC) 

CALL  UTKAmiNTAPE»*t) 

ITAFCL  IS  1HC  LAULl  OF  fAPt  F 


SIT  MOUC  •  fMC  MOLC  (IF  INPUT  I’ATA 

NONE*# 

IFlMia.  CO.  *0UNM1L*I  NOOL31 

iFimo  .co.  •acCFMi*)  nooui 

Ip  (MIO  .CO.  •COCNC.I*!  M00fcs3 
IFIHOOC  .CL.  •)  SloP  MOuCfcS 


MCAO  IUPUT  CONTROL  PAAAK.TERS  FRO*  OATA  CARO  t 

100  RLAOdNCARUtlOAl  i*  T.NhT.MN.  ISM.Kkk.  ISJ  . IS*.  IS3.IS*.  ISS.SFX.  (LAIC 
tL(l)*lsltO»*ITHCC 

102  FORMAT (SIS.IS.  t*.'<4ll.PL0.i.»)0X.3A4.  A*.  ILL 


TCST  PM  Enu  of  moona< 
IpINNN.LC.OI  OO  Tu  «N*0 


PRINT  liONiT  wO>4lkJL  PAAamCTLkS 

OnlTCI  IPRNfR.ir3|HF  T»NMT»|«#IV  ISR*RAK#fFX»  1TNCL*  ISlf  IU*  1S»*  IS*.  TSS 

l»CkAKL(I)«ial»*> 

104  FORMAT (/1«*//1SX*  PAtfA*.TtKS'///l*X» »*FT  a  *.IS//  tl*. 'MPT  a 

4  ».!*✓/  IM.'NNN  a  *.IS//  ill.MM  *  '.I*//  MI.'UK  a  •*!»//  «3X. 


3 


IN  Ho.  TC-S-73 


*•  •FtO.O//«OA»  ‘XTnCc  a*  •  II//1M*  •MITCH  KTTlNOS*//MXt  •  I&l  * 

4**u//23x»*rvz  **»4i//<-x»*isj  •»»it//jox»*is»  *•» 

<»U//l*A*«Uuei.  S  ••iAO.M) 


KC/Ul  OC-aINEJ  *M*.  <IbTH  CONTAcL  »A*AMCTCM  mOH  DATA  CAM)  ? 

t'lsi.o/ruuTtis*) 

AuuHI.iCARm'U*) 

u**  Fv«H*f(jaic..»,n#) 

Jr  r*<fc^CO-TU$V)/rC(MT(H^) 

IFtJO.cT.OrTAJL)  «*ITHIRnnT».11M  '<*TA»« 

Uw  Fjrt'«T(/»*»*F*4C*'UL«CY  1  .rt4P0LATIufc  IS  l-CXNS  l*<*OAMKt.THt  TAUT  AC 

iSwcurioM  (a  *«r (•.«•/) 

1U  ,«HSlMlM4^i.jf|/0»»l 

*0  10  U‘- 

Atir>H*rLO»*t*'«l*jr.O 
t>V  lU  til 
Uw  RArtafLOVAwT 
A«rti»-i)F«4c : 
it*  I 

MWAS« 

Id* 

iria.d(.A<WU)  lv  n  1M 

■WiliWl 

«v  10  UA 

it*  *«  to  it/ 

NTfeCMAAM** 

w  to  in 

U/  NAiaA.nJiMM) 

umni  aiu*i  ««am«^cw*  r  i  ttf'mn 

WtAtteMlHAWnTUh.  T 1 1  W*AW  I 
iM«irsiiMiNiA«it*»  wTf»«rwa.iNiiH,t«tU  .naaa 
It*  rONKlTllOlt'jr  «S»1I.I*I«|"»  «**Mt.A*M.*AU)«  *•  •/)•.«.»).  »Ah|* 
•  N  iS/il.A.Ili'ini  tSUttt.'U,  S*«|A»Sa»*NMA  •••!)> 

CA4.C  tfMCosiCCtU./ 

C4U  kklOMllL«n.«Ui*WitItrMttAiu>MN4<IMMI 


wAA.CU.Alt  CtfSTAMlS 

!•  <ir*it.c.u..9>  *Tjr-  itm:c 

Cau  «*UNNU>  U.lWcUltlA-tH/l  I 

T«»u.A  l /n.0- »«>••«» 

Stlto.l 

lr«ttl 

IpmImTsISA 

IruOTaitt 

NMtCsf SPA*  N£<«u  -w/.«CM 
D(>MC.U.f>  *T0r  MCC 
MJ.kJ*sITAcC/(  A**C*NHtU«  I 

I^AcA«hA(C«mn*h/2 

»FTSS/«NDt*J*-t 

•MfcCOA*»Itf«Cft 

1  .-M.rTUM'  T|. JilSU* »-*.•» 

1.04  IS  AC*  SO  *V<  CCNT  0WAM.4*  t.*M  |A  *0»<  ■  IM'O* 


:* 


* 

i 


✓ 
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« .  §•  <  f  ac  t  ♦  4 « .  a/s^KT  ( eof .  a  > )  i 

SCO.  *«!•. ••(FACT-41. 0/S  *tTtCDF-1.0>>> 
NtCFAlFlKiTF^C.*) 

L4utL<  iSIAmDIVJ*' 

ShMT 

It  (lHACK.tu.O.OP.i.tl.Cfc*!)  NFFTS*»luISJP 
CvM.STSuT/FwOAfl1  »«•«! 


PRINT  OUr  *144.0  IiF-UNmATION 
*m|  Til  |PNM»*  10* I AMR INI  ♦  IFlOTiDT* u 

19*  F«M«tA1|/l*..*|t*'t..i  (*.U//23m'iA.0T  «• » 12//20X* *I»T  *  '»E13.6//U 
,I***F  **.F*a.a./> 

•naTlI  lHMtIM*  iC**»  •wAUd.Ut  •L.AbtUT) 

it*  flmaati  i04.*rHF  hun  no  fee*  for  this  case  is  *»>ao  > 

•Ml  IC(1PRN|P»1C'  I  .tF  r*  i  f  AP*.f  *Ml» 

10V  ruN*AT<  iNMin  "AT A  -AS  Ki.‘-0  FROM  FILC*»IA»*  OF  TAPF  *.A6 

It*  IN  '  r  A4*  '  W't  .  •  1 

IM  -»U.CO.*RCOF»*T*l  Ml l£ ( |Mf*NTR»  1U?I  »(F'*T(I)tlsL»lO) 

10/  Fun '414  l*-.  •  T>+  rvAHAT  »  Tift  dCu  vATA  4 AS  *.1OA0  ) 

It-  (.‘AlUC.Ift.l.MiU*.  NfAC.N..4MNtITL(:i-.^«Tl(tl0«IMCHUft.»NCRf  TCltlCZ 
A**  Fw«nAlU0A,tf|tf.  Tm»C  M*»  ••It**  CHANNEL*.  */10A 

•  *i*tt<  NCCOteJ  nA0*»19»*  TOTAL  COUVEHSIOnS. •  /16X««CHANN 

tfL**l»*«  Am*  JC*VJliIPU»F.O  INTO  XJI  AND  CHAMftL*  tIS*  *  INTO  TY.»  ) 
I*-'t*#»1S.fe*.«nSJP>  Ml  1L( IPANTA.199) 

10*  FORMAT 4 //!»*,• THE  rOLLO-lN*  DATA  MS  NOT  AUF-  01 TH  90  PERCENT  OVERL 
AAA'1 1 


PLOT  COFCO  UOT 
LMLIklCkOftA  • 

CA*.L  luOUW (LANPt*  *TAP*t .JftHA.4.fMcK,NFl  .HNN.  ISR.KIU  .  IS1 .  IS* .  TS3. 
lilt**  Ib9«9F».9FT*0T  .0F*iO  ITNCC ) 

CAcL  FAOKOl ANOQF k*0* !• 1 1 


POSlIltfM  1  At-w  TO  CoNnTCT  Flu  ANu  record  position  before  data  read 

CAU.  TAPCP4  INTAPF.*hPT •Nr*Ttt#lLlNf  ,A<(  ClN) 


mini  EOF  Information 

T  IMSAFlOAT  «  NOISJM*.  AMI  •**  T 

ANA  It  I IPRNTR  •  IK  »•  wl  SUP*  T  INC  » tftDF 

ISO  F«nm0T 4 &OA.MHC *.!•»••  olSOOlNT  PIECES  COMPRISE* .FO.t* •  SECONDS  OF 
iOAIA  FgR  • • J%» •  EuF.*) 

MltCl  |PRHIR.1*»>'m.0NP.*C0hP 

AS*  FORMAT 4 10A**UAftt<  •AUSSIAm  ASSUMPTIONS  00  PER  CENT  OF  THE  AUTO  SPC 
ACrHAC*/tJA.*PUlM«  LIE  tllMlM'.F*,*.*  Uh  AAOVE  AND*  »F7.?»  •  OB  HCLO 
49  TM  PLOT  fell  4A..M 


cACCtfLATC  it -AT  StOP  F Ok  PLOTS 
lOTARfsl 
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STOfU.  a«OS  *N  M  liPUM  NbMVI 

ou  m  mi»wi 
P.tl<(A)*4.0 
iVw  Cwd.TlHUE 


COMOuTV  AMO  V**  IfFTk  >U«Cm  '#  r*T|«AVCft 

UO  **52  KOO.«T*l."Pr  iS 
Uo  209  1*1. »M 
2a<;)*9.9 

/tnue.o 

294  CwwTINuL 

to  v*>  nal.r -phm 


«UTUnATICAU.I  JU*'  Tw  «*A0  IMTA  If  m»M  MOuC 
SO  TO  1205*210. ?2w).M0tr- 


HCAU  OH  STNfr«51xE  OAT  A  (DUMA.  If  MAf) 

20O  CONTINUE 
00  TO  200 


nCAD  OATA  FkJM  OCt  IAPC 
210  CONTINUE 

HfcAi)  <  InTAP*..  PMT)  MXm.Ui.XW'AA) 
0O  TO  *52 


MC.AU  IMP* IT  DATA  *KO"i  MAO  T«K  IN  (OC  AOMmT 
220  CAU.  COCNCf ( I2.AX.fY. I  SPAN* IC1* IC2.I <HAM.*NCA* I'.TAPCl 

29*  r*tUXI«MAfcttri*lSP;m«tKHAHL/NCfc 

200  CuhTIMuC 


«C|0HT  nf  INHUT  ^AT*  WITH  COSINE  WINCO* 

IM1S2.E0.1)  00  Tw  997 
1SPAR1*ISP«A*(K-1) 

00  950  L* 1.1 SPA* 

XAiu*x*iu*a.9-cos(T*f  ut*Ti  im*aai«l-i  i  n  •o.oiaaOomi 

95a  CONTINUE 
957  CONTINUE 


COMPUTE  PARIlTIONtX  CHIMP  /-lMAMSfOHM 
Ou  992  jsl.lSPAP 
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IN  M*.  TC-S-7J 


nuiai.i 

IH  dMlIltf 

m  M  tii>w 

MU  (uTb%| 

J*«#  CMfMuC 


MMifl  yui«t 


V  aM  uitM 
»M  Cw*«*I  «ut 


w*u  rwt  u*cr  kcim  m  ti  mpomt  Nnm 

U  lt«U..k/IM  t  ••  fl  »M 
(«U  «lMtM  |Nf<Tn« 

C4U 

•M  CMTInC  1 


4  BmC*  nm  4<T  >MU 
ctNtua 


uivjii  vi^n 


MIMI  Cu**1«w».  NtMim 
b»i'CUF(NMO.a0») 

MU  FuMrt*T(lMi.<U>*lMHwT  CO“T*gC  HMUUt  rtftfc  rg«  TML  MKfHlNI  OF  THIS 
l  AtOMC 

«U Tt (IMINt «,*•*>  UDIS^iUtfF 

**»  Fg**4T</0M.  t  fHfc.  Ntf^JCK  OF  alSJOIM  *»ICC*»  X*«  M  AnCMUT  SFCCTOAl 
iC%1IM«rC  a«»IS»//VA«*TMt  IVJIVOUI*)  NUMKR  OF  UtMtH  0*  FNCCOOM  S 

Kill n |  l«jM|h»SHl  i<dl#ilCIMF 

U«  »OhMT»/f»,*Nj'«Tl  KM  ct»if  Cu^lUi'CC  M(  »*F10.’/> 


KO**4±UL  E>»I*tt|cfc 
f  NsOMlOA  f  if#F  1SI 
tu  .kT*C  ON* I  AOFrfM 

«*•*  Ow  <*02  KSl*KM 

FHiAUt>FHi«|lO*Ca<ST 

002  CwmTIMOC 
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m  m.  ic-i-Ti 


»•»*!  dm  * 

C4i  •4tfMiUIMfS'U*OT«  <«»«,r*:i*rx, ,***!» 

MX  Mto  IstiM 

M4M<  t  l«|4.+»M.0QU  (MU  IPm  Id  m  •  I  .4*  -*•  » I 

Ha  ch,tHm| 

Ui  t%ff»niiHix*u«>kxakL^«orixboi,iM!.iri 

CAU.  L»  X  iWHi  ISfc.Mto»ISi»IW*113» 

u#*»  liiM  •pu.si'y.ui  «ur»MhMb«  i  n«C) 

tta  L|*#t «  I  ST  AMI*  I STOP.  TITLCA* 

illltfVil) 

CACL  «>Ai|»t*NSOfS»S»l#l) 


«•  (UC*  Ft*  -MAT  UtmJC 
M  TV  IN 


tMUNlTl 

MS  C-CL  CUf«l«NUUT.|i 

C MX  *TSMm  IMTAPt.it) 
N*  SUP  M 
SMI 
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AFfBOlX  » 

LISTING  OF  SUBROUTINE  LSEQU 

SoaHOUTlNt  LSCWU  CwMP«J1u5  THE  L  POnT  StMNtt.  IT  It  UWO  WITH  SUBffOUTlNC 
CHim u  TO  wOMPUTK  HC  N  X)  IF  ICC  CHIN®  2- TRANSFORM.  J.FCFR1E 

»MCM  i7»l«T3. 

BlwClOwMAPn  AC  Hfc*lMCi«£ 

*.lLLli««»Sft  'i  A.»*A  SlOOt  OK  THc  L«tRP  Z-TNAMSFOftM  AND  ITS  APPLICATIONS* • 
KaCS AS  STAlt  JNlVL.iSITv  •MCTCMS'S  T.CSIS*  MANHATTAN* KANSAS  19T2. 

SOMaOUTINC  U£^Maa.7T*LC*MMN*M4***I.*RaPM#RSPM» 

niccNSiON  Axm.tt cn.ccui 

Pa  I A  k*PI/o.2.131'.*jj07/ 

U*AXR2»»I«HaPH 

t>«^sM2Pl*RwP.I/2.C 


FORM  T»lt  KOC.(Ht|i.i>  L  POINT  acOUCHCC 

OU  120  lal.F, 

FIMISFlOAT(I-I) 

T)«crAl30N2«FI;UA*2 

XA(l)scOSClHETAl) 

mi)3-SIN(TMETAl) 

120  CONTINuF. 

IML.Cu.H*.«*-l)  Oo  TO  126 

CMnN1«L-NN*J 

Miami 

OO  125  13Ma»cKNH1 

XX ( 1)30*0 
YKDSO.O 
125  Cor.  T I  Noe 
J2o  CONTINUE 

LM*»P2=L-fF4*2 
Ou  199  IsCnNPZrL 
FlMlaFcOAT 1C*I+1 ) 

TH6TA1sON2*FIM1*«^ 

XAd)scos(iHerAi) 

YXI)S-SIN(T.<trAl> 

130  CONTINUE 


COMPuTF.  THE  l  POINT  uFT 

CalL  MKLFFl (XX*YY»LCtMMNt-l) 

RtTURM 

tNL 


IN  No.  TC-5-73 


^^NOIX  C 

LISTING  OF  SUBROUTINE  CHIRPZ 

SUBROUTINE  CH14*1  w0(#ut!«  TMt  M*  <01*  ICO  CMfMP  im >TftAM>PONM  NMEN  UHO  KID* 
SUBROUTINE  UitWi  JiHmRII  •••  ''ONCtl  Af»&9T3« 


HiuLlUOMAP)  >1CAC  REfCREnCC 


wuu.x««*s»rc*c  *.•**  *rJ»'Y  oo  n#  chimp  i-tma— pomm  and  in  applicatu 

HAfcCAS  STAir  UNl%t«SITT  NAfcTfrS**  THESIS*  MAfMATTAta*  KANSAS  ifT». 


Suu.OuriNt  C»U«AZ(*<iT»»lf*#W**L*fL»CC#*!«OliHN*A»tiMFNiBl#H) 

bIMkNSICN  AX(lhTrillM<U>iVfU>t*l.(ll«YUl)«CCUl 
OAl*  M^Pt  A*.  *i*t  *»*<>'/ 

c<aoUAi*M«PH 

1  «MMP.-t/4  .  ? 

(X)  109  ISlrKH 
OlMlSFtOAUI-l) 

Tut  ( AlsT  IXU <0M2w  iHl-C  -t  I 
VA(I)«XX(I>*COS(TrM.m>-  'Yt X » •si-*« t;«*et<*i  » 

VM  i  »f  v  ( 1 1  *COS<  rMbTAl  I  »KX  ( I )  •&!’<(  1’CTAl  > 

10U  CQnT  IRuC 
NHP1»«I41 

00  lie  XsNUPltC 
vxiiup.e 
V1UI30.0 
110  COhTINUC 


COMPUTE  FWU..RU  bn 

CALL  HKLFFr(VX*Vr»*C»M*  ;#-!> 


fJULTiPLT  THt  SCQUCHCt  WITH  T«*  L  POINT  SEQUENCE  F»ON  SUBROUTINE 
U*iU 

no  149  lsl,L 

XA(X»s»Ul)*VXil)-rL(I)*VT(n 

Tf <l)sYL(X)*VX(I)^AL(I)*Vt (1) 

140  COuTXNjE 


COMPwTE  T*^E  iJFT 
CALL  HtLPFTIXX»TT#0C»MM»*4l) 


OHlSl,0/PLuAT(U 
Dw  ISO  Xsl*fc 
KlMlsFtOAT(I-l» 

TMt T A lsON£#F I H 1 * ♦ t 
.  XbAVE— XX ( 1 t 

AXU)=uNlMXXlI>  *CUblTri^TAl)-im  I >♦ \INlTHtTAl > > 
TY  ( I )  sunl*  <  V Y <  X 1  •tUS(ThMAi)  ♦XSAVfe*SINlTHfcTAl ) ) 

ISC  CunTXHuC 


RtfUR>« 


NU8C  Tsohnicel  Memorandum  TCI  -2-74 

17  January  1074 


Coherence  Estimation  Via  the 
Partitioned  Modified 
Chirp-Z  Transform 


Q.C.  Carter 
C.  H.  Knapp 

ABSTRACT 


This  is  the  oral  version  of  a  paper  presented  (in  7  minutes)  on 
17  January  1974  at  the  1974  IEEE  Arden  House  Workshop  on 
Digital  Signal  Processing,  Harrlman  Campus  of  Columbia 
University,  Harriman,  New  York,  it  defines  the  coherence, 
discusses  uses  for  this  function,  and  briefly  examines  issues 
regarding  its  estimation. 
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meauromont  of  signal  a  noise  power  ratio,  and  do  termination  of  Nine  delay. 
In  the  system  Identification  problem  wham  M  maps  x  into  y,  It  eon  be 


shown  that  If  M  Is  a  linear  mapping^ than  da  magnitude  coherence  equals  unity. 
On  the  other  hand.  If  x  and  y  are  uncorrelate^then  the  magnitude  coherence 


equals  zero  (Ref.  2). 
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Another  we  of  the  coherence  is  to  measure  the  ratio  of  the  signal  power 


HI  1CW-H 


1  >>  wlpO  af  a  Hw t  flHar  M  to  the  woNo  p ewer.  In 


If 


W  Mm  noise 


MR  U  4*RmM  Nr  IN  eoheroRoe  between  »  y  Hw  power  spectrum 
of  y.  IpuNMIy,  If  IN  r^^HuN  nNwim  W  Mlly,lNfi  Is  no  naNt 
«Nfwi  If  the  MplRN  eohemnee  h  am,  then  the  output  It  all  noise  (Ref.  I). 

N«XT  SUM  fUAU 


iMMyflatt  Ir  •Am^rm^  tee 

•P^SPfi K#g*  HMSHwSjpWJr  @w  PS?  ftSPPi®  PPm&$  Hi  mm  Sft 

PH  HHPPe  ilfHR#  9|  H  iHVHil  P  fWQ  P1PI  Wlffl  PfKN  pOWP  Wi  PnwfnT 

itltHyt  Mhm  Nity  A.  N  oMHm,  mN  signal  N  earrupM  by  addltlvt  nolaa 
end  flltand.  Wban  and  Rj  ora  uneorreloted  but  hava  the  tow  power  spectra, 
(ban  the  roMo  of  fba  signal  la  noise  power  It  given  by  ibo  magnitude  coherence 
over  ana  ainw  the  magnitude  coharanca  (Raf.  1 ).  Estimation  of  the  raloHva 
Hw  delay  can  ba  accomplished  using  tha  Smoothed  Coharanca  Transform  discussed 
in  tha  October  Issue  of  tha  Proceedings  of  tha  IEEE  (Raf.  3). 
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In  discussing  tha  problem  of  estimating  the  magnitude  squared  coherence, 
the  bias  error  will  be  considered  first;  then  an  estimation  technique  which  reduces 
this  error  will  be  presented  (Ref.  4).  The  maximum  bios  error  under  the 
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attumpllew  that  sufficient  frequency  KMltttiw  U  available  It  one  ovtr  the  number 
af  segments  (Ref.  1)}  haneqfor  100  togmen*  the  maximum  bias  It  wily  one 
ana  hundredth.  Whan  tufflaia#  resolution  It  evelldblt^  variance,  NOT  blat. 

It  a  serious  prablam.  If  an  Iba  atnar  band,  the  nuater  af  Independent  data  points 
P  far  aaab  segment  It  too  aaotl,  than  tba  resulting  poor  frequency  resolution  can 
aauta  serious  blat  errors  In  estimating  cobaranoa  (Ref.  S).  In  fact.  In  some 
catat  af  insufficient  resolution,  the  maximum  bias  arror  bat  baan  ebtarvad  to  ba 
Indapandant  of  tba  numbar  of  segments  averaged  (Raf.  2).  Spaelfle  examples 
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any  blot  I  at*  than  ana  could  ba  scooted  If  aufflaiant  froquancy  raaolution 
ween'  t  ovoi labia.  Tba  practical  bapllcaNan  of  this  lladtoHen  It  that  P  mutt  ba 
large.  Tbit  apparently  requires  camputatlen  of  a  large  tlsa  fat  Fourior  transform, 
or  FFT  (Raf.  A).  An  ollamatlva  computation  which  roducat  tba  required  FFT 
tlsa  it  tba  ForttHonad  Medlflad  Chirp  Z  Transform  or  PAM-CZT  (Raf.  7). 
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In  this  technique  tba  Chirp  Z  transform, or  CZT,is  modified  to  evaluate  a 
large  but  limited  numbar  of  points  on  the  unit  circle  In  the  z  plana.  A  sectioning 
algorithm  is  used  to  partition  each  P  point  segment  into  several  smaller  pieces 
(Ref.  7-fl).  The  smaller  piece^or  partitions, are  then  processed  in  short,  time 
ordered  sections  which  arc  recombined  with  an  appropriate  phasing  function. 

This  technique  for  computing  a  PAM-CZT  allows  for  computation  of  the  coherence 
in  a  manner  paralleling  FFT  techniques.  However, now  a  PAM-CZT  is  performed 
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In  «f  on  PPT.  CwwK  resssrrh  on  Implementation  of  the  CZT  (*of.  9-1 1 ) 
should  toon  load  to  Insiysnslvo  PAM-CZT  herdworo  for  eoKoronco  estimotlon. 

In  summmy,  kncwlsdps  of  the  coherence  function  to  useful  for  system 
MwHflooMon,  oowrlni  slgnol  to  notoo  power  rotieqand  determining  signal 
Haw  do  lay.  Currant  Wudto  Indleoto  Hwt  those  powerful  footuros  of  Hw  coherence 
eon  bo  roallud  tbrougb  tbo  PAM-CZT  pro  cosslng  technique. 

Tho  significance  of  providing  frequency  resolution  limited  by  the  physical 
characteristics  of  tho  problem  and  not  of  tho  processing  technique  are  that 
while  tho  bias  oner  of  tho  coherence  estimate  is  not  o  problem  if  sufficient 
resolution  to  available.  It  to  a  very  serious  problem  if  proper  resolution  is  not 
available.  Analytic  results  presented  previously  foil  to  point  out  this  significant 
shortcoming  of  coherence  estimation  and  how  it  can  be  overcome. 
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Approximations  for  Statistics  of 
Coherence  Estimators 


A.  H.  Nottaii 
0.  C.  Carter 


ABSTRACT 


Approximations  for  the  bias,  variance,  and  meen-equare 
error  of  estimators  of  the  magnitude-squared  coherence  and 
magnitude  coherence  are  presented.  The  approximations  are 
accurate  for  ail  values  of  true  coherence  and  over  the  prac¬ 
tically  useful  range  of  N.  where  N  is  the  number  of  averages 
employed  in  the  coherence  estimators. 
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APPROXIMATIONS  FOR  STATISTICS  OF 
COHERENCE  ESTIMATORS 


INTRODUCTION 

Expressions  for  the  probability  density  Auction,  the  cumulative  distribution 
function,  and  any  moment  of  the  estimates  of  magnitude-squared  coherence 
(MSC)  and  magnitude  coherence  (MC)  are  available  in  references  1-5.  The 
expressions  for  the  moments  usually  involve  a  generalized  hypergeometric 
function*  3F2  and  require  a  time-consuming  computer  effort  for  their  evalu¬ 
ation.  Also,  the  fundamental  dependence  of  statistics  like  the  bias,  variance,  and 
mean-square  error  on  the  number  of  averages  N  and  the  true  coherence  are 
not  obvious,  because  of  the  lack  of  significant  results  for  the  3F2  function. 

This  report  will  seek  to  present  accurate  approximations  for  these  statis¬ 
tics,  of  as  simple  a  nature  as  possible,  and  capable  of  hand  calculation.  Also, 
the  dependence  on  N  and  on  the  true  coherence  will  be  deduced,  and  thereby 
future  experiments  can  be  designed  in  which  the  required  stability  can  be  pre¬ 
dicted  and  attained  with  ease  and  certainty.  As  a  by-product,  a  technique  for 
reducing  a  particular  type  of  3F2  function  to  a  Gauss  hypergeometric  function 
(reference  7,  chapter  15)  is  presented. 

ESTIMATION  OF  MAGNITUDE-SQUARED  COHERENCE 


The  complex  coherence  between  two  jointly  stationary  random  processes 
x(t)  and  y(t)  is  defined  as 


v® 


°xy(® 


(pxx<*)  ®yy^] 


1/2  ’ 


(1) 


where  Qxy(f)  is  the  cross-spectral  density  at  frequency  f,  and  G^ff)  and 
Gyy(f)  are  the  auto-spectral  densities.  The  MSC  Is 


C(f)  »  |Txy(f>|2  . 


(2) 


♦See,  for  example,  reference  6,  section  9. 14. 


The  MSC  is  frequently  estimated  according  to 


where  N  le  the  number  of  data  segments  employed,  and  X^f),  Yn(f)  are  the 
(discrete)  Fourier  transforms  of  the  n-th  weighted  data  segments  of  x(t)  and  y(t). 


GENERAL  RELATIONS 


The  m-th  moment  of  the  random  variable*  2  for  independent  data  segments 
is  given  in  reference  1,  (4)  and  reference  2t  (3)  as 

E|cml  *  -  C)N  3F2  (m  +  L  N,  N;  N  +  m,  1,  C)f  (4) 

where  C  is  the  true  MSC  and  3F2  is  a  generalized  hypergeometric  function. 
The  power  m  need  not  be  integer  in  (4). 

For  m  «  1,  the  first  moment  of  C  can  be  reduced  (reference  5,  appendix  B) 
to  die  simpler  (and  rapidly  convergent)  form 

C  F(l,  It  N  +  2;  C)  ,  (5) 

where  F  is  the  Gauss  hypergeometrlc  function.  For  m  =  2,  the  second  moment 
of  C  can  be  reduced  to  the  simpler  form  (see  appendix  A) 


N3  -  2N2  +  2N  -  2  N-lr,  t 

M2» - - - +__[N2  -  (N-2)Cj  F(l,  1;  N  +  2;  C)  ,  (6) 

which  involves  the  F  function  with  the  same  arguments  as  in  (5).  Equations  (5) 
and  (6)  give  exact  results  from  which  the  bias,  variance,  and  mean-square  error 
of  the  MSC  estimate  C  can  be  obtained. 


*The  f-dependence  is  suppressed  for  convenience. 


BIAS  APPROXIMATION 


The  bias  of  C  is 

Bias(fi)  -  E{filc,N}  -  C  =  -  C  .  (7) 

By  expanding  F  in  (5)  in  a  power  series  in  C  and  retaining  terms  to  order  N”2, 
we  obtain  the  approximation 

Biaa<£)  *  i  (1  -  C)2  (l+x)  ‘  (8) 

Plots  of  (7)  and  (8)  are  given  in  figure  1  for  N  =*  8  and  16.  The  discrepancy  be¬ 
tween  the  exact  result  (7)  and  the  approximation  (8)  is  barely  discernible  for 
N  »  8  and  is  not  discernible  for  N  *  16.  The  discrepancy  (between  (7)  and  (8» 
is  even  leas  for  larger  N.  Equation  (8)  is  a  much  simpler  and  more  accurate 
approximation  than  reference  2,  (5).  The  bias  and  approximation  are  observed 
to  have  a  peak  of  value  1/N  at  the  origin  and  to  decrease  monotonically  with 
the  value  C  of  the  true  MSC. 


Figure  1A.  N  *  8 
Figure  1.  Bias  of  MSC  Estimate 
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Figure  IB.  N  *  16 

Figure  1  (Coat'd).  Bias  of  MSC  Estimate 
VARIANCE  APPROXIMATION 

An  expansion  for  the  variance  of  C  is  given  in  reference  2,  (6).  If  we 
«rp«nH  the  bracketed  term  to  order  N"1,  we  obtain  the  approximation 


Variance(C)  s 


N(N  ♦ 1) 


-  C)2  [2 


1  -  6C  +  13C^ 


This  result  can  also  be  obtained  from  the  exact  expression 

Variance  (6)  ■  m2  -  n\  (1°) 

combined  with  (5)  and  (6). 

Plots  of  (9)  and  (10)  are  given  in  figure  2  for  N  *  8  and  16.  The  discrepancy 
between  (9)  and  (10)  is  barely  discernible  for  N  *  16  and  is  not  discernible  for 
N  >  32.  Equation  (9)  is  a  much  simpler  and  better  approximation  than  refer¬ 
ence  2,  (6). 

For  large  N,  the  peak  of  the  variance  occurs  at  C  9  1/3  and  is  of  value 
8/27  N”1.  Thus,  even  when  the  true  coherence  is  unknown,  the  maximum  vari¬ 
ance  will  be  less  than  0. 3/N,  for  large  N. 
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CXPANBI0N8  ABOUT  8-1 


If  the  rMuita  la  (5)  aad  (6)  art  expanded  about  S  >  C  «  1  by  meaaa  of  ref- 
erases  7,  equation  15. 3. 11,  we  Had  the  asymptotic  expaaslons 


*'e*  *  c  +TTT<l-c»J  - 

T  ^  M  + 

(N-2)(N-3)(N-4)  u  ^  •** 


(20) 


e|C*I  - 1  -  a(i-c)  ♦■jjrfa-c>2 


■  (W-'S(M-i)  (1'C)3  +  (5TT*(S-3)2(N-4)(1"C)4  +  •  •  •  (21) 


ct*H7iil-ci)%  m  ar-2f(w-3>(1"c8>8 


♦ 


«  + 


N-N2 


18 


I  -  2)<N  -  3)(N  -  4) 


(1-C2)4  ♦  .  .  . 


(22) 


upon  regrouping  tanas.  Express loas  (80)  sad  (22)  are  useful  near  C  «  1  aad 
ladle  me  hoar  rapidly  E{Cm}  -  Cm  approach  aero  as  C  approaches  one,  for 
m  -  1  aad  2.  tt  will  be  observed  from  (20)  md  (22)  that  the  coefficients  of 
(1  -  C*)J  aad  (1  -  Cm)3  are  Identical,  aad  those  of  (1  -  Cm)4  are  similar. 

R  was  thought  that  £{8}  «  ijC1/*}  might  possess  a  similar  expansion  in 
powers  of  (1-C*'")  «  (1-8)  and  provide  a  useful  method  of  evaluating  (15),  at 
least  near  8  -  1.  In  appendix  B,  it  is  indeed  shown  (after  considerable  labor)  that 


s{8}  - 1  -  y  (i-C)  -i.  Ifyd-C)3 


1  N3  -  7N  ♦  16 
18  (fc-2)(N-3) 


(1-C)3  ♦  .  .  . 


(23) 


-8  ♦ 


1-2  (1"8)*  ‘  (N - 2)(N - 3)  (1"  8)3 


(24) 


9 


(upon  tanas),  which  has  tbs  identical  coefficients  as  (20)  sad  (22), 

op  through  tfas  ordsr  computed.  Equation  (24)  shows  that  ths  bias  of  the  ICC 
eetftmste  S  approaches  ssro  as  8  approaches  one  according  to  (l-8)2/(N-2). 
Also,  (14)  aad  (20)  eaa  be  combined  to  show  that 


This  corroborates  reference  4,  (8). 

CHOICE  OF  APPROXIMATION 

Expansions  like  (20)- (25)  cannot  be  used  to  evaluate  the  desired  statistics 
for  small  S;  in  tact,  they  are  divergent  asymptotic  expansions.  When  this  in¬ 
formation  is  combined  with  ths  earlier  results  about  S  *  0,  we  find  that  direct 
analytic  expansions  of  (18)  are  not  fruitful,  in  contrast  with  the  earlier  approach 
for  MSC  results.  we  must  adopt  some  convenient  simple  approximation 

aad  try  to  match  it  to  the  exact  results  in  some  fashion.  (The  techniques  in  ref¬ 
erence  12,  chapter  9,  are  relevant  in  this  regard. ) 

Before  we  do  that,  however,  it  is  necessary  to  digress.  We  know  that 


Bias(§)  ■  BIS}  -  8  ,  (26) 

Variance  $)  -  E{S2}  -  E2{S|  ,  (27) 

Mean-Square  Error  (§)  -  [Blsa(S)]2  +  Variance  (S)  ,  (28) 

where  the  exact  moments  are  given  in  (15)  and  (16).  A  very  good  approximation 
to  Eld2}  »  E  {£[  is  already  available  from  (7)  and  (8),  namely, 

EjCb  C  +£(1-C)2  .  <29> 

or 

E{§2}  *  S2  +i.(l-S2)2  (l  .  (30) 


Therefore,  if  we  can  approximate  E{§[  or  Bias  (S)  or  Variance  (S)  in  (26) 
and  (27),  we  will  have  approximations  for  all  three  statistics  in  (26)-(28). 


Initial  attain pu  concentrated  <mi  approximating  tin  blaa  (26)  by  tha  form 


a  (1-8)*,  *  >3  , 


(81) 


wbara  a  and  a  vara  choaan  ao  aa  to  natch  tha  axact  bias  and  Its  dartvatlva  at 
8  »  Os  thaaa  attanpta  wara  not  successful  for  all  N  and  8.  A  generalisation  to . 
tha  lorn 

2 

h.-flfcftg-.  ’>3  ,  (32) 


was  quits  good  for  N  up  to  100,  but  deteriorated  for  larger  N,  despite  also 
matchl ng  the  axact  second  derivative  of  tha  bias  at  tha  origin.  Numerous  other 
forma  ware  triad  for  approximating  tha  bias  but  yielded  poorer  approximations. 

VARIANCE  APPROXIMATION 


Succeeding  attempts  wara  aimed  at  approximating  tha  variance  (27).  It  will 
be  recalled  (from  tha  diaeuaaUm  under  (16))  that  (27)  in  an  even  function  of  8. 
(This  even  property  la  not  true  of  (26)  or  (28),  because  of  tha  8  term  la  (26). ) 
The  approximation  to  tha  variance  urns  therefore  also  choaan  to  be  even;*  after 
much  trial  and  error,  an  acceptable  form  waa  found  to  be 

VtrtMKn  S>  "TgETy  —  *  **">  •  <**> 

The  landing  term  in  (33)  is  dictated  by  (25);  tha  second  term  In  the  bracket  was 
deduced  from  observing  the  numerical  values  of  the  variance  near  8-1;  and 
the  numerator  of  the  third  term  la  chosen  to  make  it  decay  taster  than  the  other 
two  terms  near  8-1.  Equation  (33)  already  matches  the  value  and  derivative 
of  the  exact  variance  at  S  -  1,  and  the  three  constants  ware  chosen  ao  as  to 
match  the  value  and  first  four  derivatives  of  the  exact  variance  at  8  -  0;  see 
appendix  C.  The  end  result  of  the  Investigation  is  that  the  constants  are  given  by 


A  -  -0.571  ♦ 


1.75  0.760 

-FT*  — 


B-0.752  N-3.26 


D  -  0.221  N*-  1.86  N 


•See  reference  12,  pages  108  and  118. 


(34) 


r  r 


approximation 


Figaro  41.  N  -  1024 

Figaro  4  (Coat'd).  VorUnco  of 
MC  lotlmoto 


At  the  origin,  we  have,  from  (15)  and  (16), 


_  /.  »\  1  »  1  0.215  0.196 


(37) 


Here,  we  have  employed  the  approximation  (reference  7,  equation  6. 1. 47) 


rwrg/i)  ,  "fift 

T(N  +  l/2)  JR 


(38) 


which  ia  excellent  even  for  N  a a  small  aa  2. 

BIAS  APPROXIMATION 

If  we  eliminate  £{§}  from  (26)  and  (27),  and  then  employ  (30)  and  (33), 
we  can  express 

Bias  (jS)  -  [fOT  -  Variance  (S)]1/2-s 

*  [s2  (1-S2)2  (x  -Tr)  -«lpp|  -  s  i  bw  .  (39> 

This  approach  is  in  line  with  the  observation  made  under  (30).  The  approximate 
variance  e|pp  in  (39)  is  given  by  (33)  and  (34). 

Plots  of  the  exact  bias  (26)  and  the  approximate  bias  (39)  are  presented  in 
figure  5  tor  N  •  8  and  16.  The  exact  blaa  decreases  monotonically  with  S  and 
has  an  origin  value  of 


Bias  (§|s  -  0)  ON  .  (40> 

from  (15);  an  excellent  approximation  to  is  given  in  (38).  The  discrepancy 
between  (26)  and  (39)  is  barely  discernible  for  N  »  8  and  Is  not  discernible  for 
N  *  16  up  through  N  ■  1024. 
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MEAN-SQUARE  ERROR  APPROXIMATION 


Thl  «fpw<  wHiw  to  tho 
trio  (28): 


mean-square  error  la  immediately  available 


Mean-Square  Error  (8) «  bjpp  ♦  •«PP  • 


where  the  approximate  bine  and  variance  are  given  by  (39)  and  (33),  respectively. 
Plots  of  (29)  and  (41)  are  presented  in  figure  6  tor  N  ■  8,  16,  64,  256,  and  1024. 
The  discrepancy  does  not  go  to  zero  as  N  increases;  however,  it  is  small  over 
the  range  of  practically  useful  values  of  N. 


The  peak  value  of  dm  mean-square  error  occurs  at  S  »  0  and  Is  of  value 
l/N,  as  is  ossa  from  (16).  The  mean-square  error  curve  is  composed  of  two 
distinct  regions,  one  near  the  origin  where  the  bias  dominates,  and  one  for 
larger  S  where  the  variance  dominates;  this  explains  the  hump  in  the  curves 
for  larger  N. 
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SUMMARY 


Approximations  for  the  M8C  estimate  are  given  by 

BU.{C)t-ia-C)*  (n-?) 

VurUDCtC)  (1-  C)s  [ic 

Mean-Square  Error  (6)  !  (1-C)2  |c  +  —  7C  j 


Approximations  for  the  MC  estimate  are  given  by 


v*rt““<s>«$ror 


l-yU-S2)  +A 


q-s2)1  1 

1  +  B62  ♦  DB4] 


where 


A  -  -0. 571  ♦ 


1.75  .  0.750 


B  •  0.752  N  -  3.26 
C  ■  0.221  N2  -  1.66  N  . 


«  • 


1 1/2 


Bias 


-Sib. 


*>  »  [sS  <1-S*,2  (l-^  -.*,*]  - w 

Mean-Square  Error  (3)  f  b|pp  ♦  sjpp  . 


<•) 

(•) 


01) 


(33) 


(3*) 


(39) 


(4i: 


20 


H 


< 

i 

i 


11/M 
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(A-i) 

ItflUWMl, 

(A-I) 


(A-3) 


(A-4) 


(A-5) 


(A-«) 


1  <*>k 


1 

k*N«-l 


N*1  (No*)* 


(A-7) 


A-l 


■  '.••'.s', 

<*  *«V 


K0-*>  f*  ? 

w*T  fa  <*♦ i*  XT 

-  <1-0*  |f*  b;  b\  C)  N;  N  +  l{  C) 

c>(  * 


(A-8) 


(A-9) 


spa*  iMflajrMtt  of  iffcwoi  7,  ignitka  18. 1. 1.  By  dm  of  rebmct  7,  equa¬ 
tion  18.  S.  I.  ilia  eaa  la  manipulated  Into  the  form 


*f  l*?1"1#1"**  (1-0  F(l,  1*  Ha- l,C) 


(I“  C>  r<*» l*  *+t»  C>  • 


(A- 10) 


t  Is  particularly  food  lor  developing  In  a  series  la  (1-C)  by  use  of  refer- 
7.  equation  18.3.11. 


At  this  potot,  a  Ml tl tads  of  alternative  forms  for  (A-10)  are  available  by 
an  of  reference  7,  peg*  868.  Several  rapidly  convergent  forma  involving  a 
afogle  F  fraction  are  now  listed: 


a,  .  [n2  -  <N  -  2)  c]  F(l,  Is  N  +  2;  C)  (A- 11) 

2  (H-l)(N-2)  c 

N(M  +  1)  W  +  l 

+  F+W+T)  -  <«-*> c]  CF<2’ l* N+*  c>  ^ 

,  !  + Jl^L  (1_C)  J(N  +  l)(N-2)- [n2-  (N  -  2)  cj  F<2,  1;  N  +  2;  C)J  .  (A- 13) 


H  J*' 


|'!y.y;y  v 
■•‘.•vv 


iV  V 


SIISH8ISS!9aM8llKi989Rn|a9IS8i|HBW^iS 
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The  form  in  (A- 11)  umi  exactly  the  same  F  function  as  encountered  in  m  in  (5) 
and  is  more  rapidly  convergent  than  the  latter  two  forms,  for  all  values  of  C. 

The  reduction  technique  employed  above  for  m  «  2  in  (4)  can  also  be  used 
for  other  integer  values  of  m.  However,  it  fails  for  m  noninteger,  because 
simplifications  like  (A-3)  and  (A-4)  do  not  occur  then. 


A-3/A-4 
REVERSE  BLANK 
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EXPANSION  ABOUT  8-1  FOB 
MAGNITUDE  COHERENCE 

The  ootlmate  of  MSC  is  given  la  (3).  Wo  lot 


^(0-O.^iSa)  >«a 

*a<*>  •  Ida  ♦  *fia)  ”  (*a  ♦  i^a)  ■  f  *a  ♦  #a  ■ 


<B-1) 


whom  ig,  Eg,  Eg,  dg  art  Independent,  sero-mean,  unit-variance,  real, 
Oauosiaa  random  variables.  Than,  for  g  real. 


*{x«<f>  Y^f)}  -  e{o,  gpi  *  Aa)}  -  Slfloal1}  •  If  5 


<B~E) 


Therefore,  tho  MSC  to 


2  *  2(1 +g*)  leg* 


(B-3) 


Tor  a  apodllod  veins  C  of  tho  MK,  tho  required  value  of  ooalo  (actor  la 
C»-l>lo 


-(r^T- 


(B-4) 


Time,  ao  8—1,  C  -  8*— 1,  g  —  «•,  and  1/g  —  0.  Bocaaoa  wo  are  latarootad  la 
8  aoar  unity,  wo  can  coacoatralo  on  1/g  near  aero. 


II  wo  define 


(B-5) 


itltutlen  of  (B-l)  la  (3)  yields 


*  -  •  «  ^'1*1  N1*!  *  '  ■  - 


IS  -.k+V 

e.-Js — b - 


lo  +  gAp 


*•♦**♦«**> 

tot1  ♦  agAO,  ♦  g*A* 

AB  ♦  l|ADr  ♦  g*A2 

wtmrm  Dr  la  tha  raal  part  of  D  la  (B-5).  Raarraafiag  (B-6),  wa  obtain 

i  +.— t  ♦- Lu 

a  1  «* 


<B-«) 


1  ♦— T  ♦- 4-V 

1  7 


(B-7) 


Mew  aaariaa 


|D|*  | 

T .  u  -  1  ■  v  -<— » 

A  ’  AI  *  A  * 

aapaaatna  of  (B-7)  la  powara  of  l/f  (aa  noted 

.*  .J  .4  .5 


(B-4»  yialda 

(B-9) 


tfca 


af-U-V,  a3  -  -(U-V)T,  84  -  (U-V)(T2-V), 

»5  »  (U- V)(2V-T2)T,  a*  «  (U- V)(T4  +  V2 -3T2V)  .  (B-10) 

ilnoa  wa  ara  lataraatad  la  the  bahavlor  of  tfaa  MC  aatimate  S,  wa  employ 


(1  ♦  «)1/2  *  1  ♦  ’  ^«2  ♦  j£«3  *  •  .  . 


(I«l  <  i) 


(B-ll) 
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Id  obtain 


(H  ***»\  1  (h  ■!  *rt  ^  ! 


And,  alaoo  wo  art  interested  in  8  noar  natty,  we  lot 

x  -  1  -  C 


(B-12) 


(B-13) 


aad  expand  S  la  a  power  eerieo  in  x.  To  do  thia,  we  utilise  (B-4)  aad  obtain 

7"  •  ^  (» 4*  ♦}**♦•••) 

*"  X  ♦  X*  ♦  Xs  ♦  .  .  . 

»  X*/*  ^  ♦  jX  +~x^  ♦  ,  . 

— -  x*  (1  ♦  2x  ♦  Sx*  ♦,,.)-x*  +  2x3  +  ... 

i4 

♦}**...) 

- -  x3  ♦  .  .  .  .  (B-14) 

«* 

Snbatltntioa  of  (B-14)  la  (B-12)  yields 


^(t**  "?•* +i*«  “£•* +  ^*i)+  •  •  •  •  (B-i5) 


• . ' 
i  A,  1  (' 

.!  w . 


Ki!vS' 

FtvtvV 

V  .« 


l;y;v;v 


SfiK 
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Now  wo  art  ready  to  perform  averages  on  the  Individual  terms  in  (B-15)  and 
obtain  an  expansion  of  E{§{  In  powers  of  x  ■  1  -  C. 

The  method  of  obtaining  E  {ag}  will  be  developed  in  full.  The  results  for 
the  other  averages  in  (B-15)  will  merely  be  stated,  and  can  easily  be  deduced 
from  the  method  presented.  From  (B-10),  (B-8),  and  (B-5), 


Pn  Qmn  •  (B-16) 


A  m,  n-1 


where  we  have  defined 


Now,  let 


Qmn  "  “m*n  “  A  6mn  • 


•  «n] 


(B-17) 


(B-18) 


Than,  since  Qmn  depends  only  on  a, 


A  m,  n»l 


(B-19) 


where  we  have  utilized  the  property 


1  {Pm  Pn} 


*mn  » 


(B-20) 


which  follows  directly  from  the  definitions  (B-l).  Therefore,  using  (B-19),  we 

have 


E|U-V}«-2(N-l)EiJ  . 


(B-21) 


Now,  A  la  given  by  (B-5)  and  (B-l)  as 


n*l 


(B-22) 


I*  t 


—  .'i; 

I,*!-.  > 


P«», 

I:v. 

V,  •* 


,’i 


b'tV. 
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Therefore,  the  probability  density  function  of  A  Is 


P(A)  .A^WA/S! 

2n  (N-l)l 


A  >  0  . 


There  follows  immediately  the  m-th  moment  of  l/A  as 


E  jl/Am}  -  — 


2m  (N-l)(N-2).  ..  (N-m)’ 


m  <  N 


Employing  (B-24)  in  (B-21),  we  have 

Eja2|  -E{U-V}  =  -  1  . 

By  employing  the  generalizations  of  (B-20)  to  the  fourth  and  sixth 
namely. 


EK  *  (‘u‘mn*‘kn‘J  • 

E  K  fi  <  PP  K  }  '  8  (*U  *■»»  *  *U  ‘m,  *op 


+  Elai^lmEpq  +®kn^tpEmq  +  *im  *np  +  *lsq  ®ip®mn) 
we  find  the  following  quantities: 

E  M  *  °*  EH}*nT2  • 

E  |a5|  3  0,  Eja^-O,  sjag}  = 

EH}  *  (N-2)(N-3)  *  E{a2a4}*"  (N-  2)(N-3)  * 
*  1*2  J  (N-2)(N-3)  • 


(B-23) 

.  (B-24) 

(B-25) 

orders. 
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(B-27) 
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Appendix  C 

VARIANCE  APPROXIMATION  FOR 
MAGNITUDE  COHERENCE 

From  (19)  and  (40)  in  the  main  text,  we  have 

e|3}«q0  +  q1s2  +  q2s4  +  -  •  •  • 


where 


Qo  =  gn 


Qi  *  gn 


N(N-l) 
2N  +  1 


Q2  =  GN 


N  (N  -  1)  (6  +  N  -  N2) 

4  (2N  +  l)(2N  +  3)  * 


And,  from  (18),  we  have 


EjS2}  «R0  +  R1S2  +  R2S4  +  ..  .  . 


where 


Therefore, 


Ro 


i 

N 


N-l 
N  +  l 


*2 


N-l 

(N  +  l)(N  +  2)  ’ 


(C-l) 


(C-2) 


(C-3) 


(C-4) 


Variance  (§)  *  a  +  ps2  +  YS4  +  .  .  .  , 


(C-5) 


where 

P  =  Rj  -  2Q0Q^ 

Y  *  R2  -  Q2  -  2Q0Q2  .  (C-6) 
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By  use  of  (40)  and  reference  7,  equation  6. 1.47,  we  find 

Expending  the  above  express  ions  in  powers  of  N*^,  we  find 

L  s\  1  e  l  65e  1 

a  *  V1  “  4/  N  "  16  n2  ■  16384  N3  *  *  * 


(C-7) 


(C-8) 


Thus,  (C-5)  and  (C-8)  give  a  power  series  expansion  of  Variance  (§)  that  should 
be  accurate  for  large  N. 

The  variance  fipprwHwiatinn  that  we  adopt  is  given  in  (33).  We  expand  (33) 

In  powers  of  S2  and  obtain 

+  »‘|*((B*l)J-D)-2^--A(B<-2j)  *...J  •  <C-») 

We  now  select  constants  A,  B,  and  D  so  that  (C-5)  and  (C-9)  match  up  through 
the  power  8*.  There  follows 


A-2(N-2)  e-  1+^- 


B 


i£|--2(N-2)<2«  +  P)J  -2 

D-  (B  +  l)2  2(N-2)  (3o4-  2fi  +Y) 


(C-10) 
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We  now  employ  the  expansions  for  a,  0,  Y  in  (C-8)  and  obtain,  finally, 

A  *  -0.  57080  +  1.  7489/N  +  0.  76047/N2  +  .  .  . 

B  *  0.  75194N  -  3. 2639  +  .  .  . 

D  *  0. 22142N2  -  1. 6648N  + .  .  .  (C-ll) 

Equations  (33)  and  (C-ll)  are  the  final  results  for  the  variance  approximation. 

It  has  been  found  sufficient  to  retain  only  three  decimals  in  the  constants  and  to 
stop  with  the  terms  shown  in  (C-ll). 
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CHAPTER  1 


INTRODUCTION 

This  research  investigates  methods  for  estimating 
the  position  of  a  moving  source  by  the  processing  of  an 
acoustically  radiated  signal  received  at  two  or  more 
physically  separated  sensors.  If  the  source  signal 
is  received  at  two  geographical  positions  in  the  presence 
of  uncorrelated  noise,  then,  depending  on  the  signal 
strength  and  duration,  it  is  possible  to  estimate  the 
bearing  to  the  source  relative  to  the  sensor  baseline. 

When  the' source  signal  is  received  at  three  sensors, 
range,  as  well  as  bearing  to  the  source,  can  be  estimated 
by  using  the  intersection  of  two  bearing  lines  of  position 
(LOPs).  The  mathematics  for  the  solution  to  the  problem 
of  finding  the  "best"  estimate  of  bearing  is  analogous 
to  the  more  general  problem  of  estimating  the  time  delay 
(or  group  delay)  between  two  time  series.  Therefore, 
this  dissertation  derives  the  maximum  likelihood  (ML) 
estimate  time  delay. 

Techniques  for  estimation  of  time  delay  can  be 
applied  to  a  variety  of  practical  problems,  in  addition 
to  those  motivating  this  research.  For  example,  if  we 
consider  a  signal  which  probes  a  linear  time  invariant 
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■yitm,  then  the  problem  of  estimating  time  delay  can 
be  viewed  as  attempting  to  identify  a  parameter  of  the 
probed  system,  baaed  on  time-limited,  noise-corrupted 
observations  of  the  system  input  and  output.  The  delay 
is  a  particularly  valuable  characterisation  of  the  system 
(and  interrelationship  between  two  processes)  when  the 
system  output  is  an  attenuated  and  delayed  version  of  the 
input.  Physical  plants  in  which  delays  occur  can  also  be 
visualized  in  terms  of  the  bearing  estimation  problem. 

For  example,  consider  two  geographically  separated 
sensors  that  receive  a  signal  from  an  acoustically 
radiating  point  source,  as  shown  in  Figure  1-1.  If 
the  properties  of  the  medium  are  such  that  the  signal 
from  the  source  propagates  at  a  constant  velocity,  then 
the  travel  time  from  the  source  to  either  sensor  is 
directly  proportional  to  the  distance  traveled.  Thus, 
the  difference  between  the  travel  time  (from  the  source 
to  each  sensor)  or  time  delay  is  given  by  the  difference 
in  path  lengths  divided  by  the  propagation  velocity. 


There  exist* 


ill  defined  locus  of  points  (relative  to 


the  sensors)  for  which  the  time  delay  is  constant.  Hence, 
knowledge  of  the  time  delay  is  sufficient  to  dictate 
that  the  source  is  located  somewhere  on  that  locus  of 
points.  In  particular,  the  acoustic  source  must  be 
located  on  the  locus  of  points  that  satisfies  the  constant 
time  delay  constraint,  namely,  the  hyperbola  in 
Figure  1-2  •  The  bearing  angle,  6,  that  the  hyperbolic 
asymptote  makes  with  the  baseline  is  a  good  approximation 
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to  tlto  trw  kMrin  to  the  so  ore*  (relative  to  the 
aidpolat  of  tOo  baseline)  especially  for  distoat  sources. 
Thee.  by  oak  lac  •  dlataat  point  aooreo  (or  equivalently 
a  plaae  wave)  aeeaapt loo  aad  solviac  for  tko  boar l no 
aaclo  t,  ooo  la  equivalently  finding  tbo  aaflo  that  the 
hyporbol tc  aayaptoto  (or  liao  of  position  (LOP) )  aakes 
with  tbo  baaoliao.  Paailllarlty  with  hyperbola  suggest m 
that  tbo  aooreo  aood  sot  bo  vary  dlataat  (rolativo  to 
tbo  oooaor  soparatloo  d)  la  ordor  for  tbo  arrival  aaclo 
to  bo  a  good  outlast or  of  true  oooreo  aaclo.  la  tbo 
oat last loa  probloa,  tbo  rooolvora  aro  atteaptlag  to 
ootlaato  boar lac  (or  pool t loo)  of  a  aooreo  that  la 
radlatlac  a  alpal  either  lateatloaally  or  aaiatoatlooally. 
Dor lac  latootlooal  rodiatloo  (for  eaaaple,  a  eoaaoalca- 
tlooe  ajratoa)  signal  atatlatlaa  aro  aaloetablo  eltbla 
certain  praetleal  aad  rogolatory  llaltatlooo.  Ia  other 
appl loot load,  the  elfaal  character let lea  aro  uakaoeo 
aad  the  ootpot  of  tbo  aooeora  Boat  bo  procooaed  without 
tbla  a  priori  kaoeledce  la  ordor  to  oatlaato  tiao  delay 
or  equivalently  aooreo  bearing.  la  tbta  tbooia  It  la 
aseuawd  that  the  aooreo  ebaractorlatlca  aro  sot  uader 
the  coatrol  of  tbo  deeifaer  aad  at  beat  tbo  epeetral 
ebaractorlatlca  of  tbo  algaal  aro  baooa  or  oat lasted. 

The  tiao  delay  eetleatloo  research  proses tod  la 
this  text  is  arrsa#ed  la  ala  chapters  and  four  appendices 
Dec a use  tbo  eotiaatloa  of  tiao  delay  and  bearing  is 
lstlaately  related  to  tbo  coherence  between  two  received 


& 


waveforms .  an  extensive  invest tgation  of  coherence  in 
gives  (la  Chapter  2).  Rev  results  os  using  coherence 
to  provide  iaforaatlon  about  linear  and  nonlinear 
ays tea  Identification  are  presented  and  proved.  Among 
other  results,  Chapter  2  explicitly  shoes  how  the 
slgnal-to-nolse  ratio  (SNR)  is  a  function  of  coherence. 

In  Chapter  3,  the  UL  estimate  of  time  delay 
betveen  two  signals  is  derived  under  jointly  stationary 
Gaussian  assumptions.  The  explicit  dependence  of  the 
time  delay  estimate  on  coherence  is  evident  in  the 
estimator  realisation  in  vhich  the  tvo  time  series  are 
prefiltered  (to  accentuate  frequency  bands  according 
to  tbs  strength  of  the  coherence)  and  subsequently 
crosscorrelated .  The  time  argument  at  vhich  the 
generalised  crosscorrelation  (GCC)  function  peaks  is 
the  time  delay  estimate  (Carter  and  Enapp  (1976a)). 

The  method  of  derivation  is  akin  to  the  ML  bearing 
estimate  derived  by  MacDonald  and  Schultbeiss  (1969) 
vlth  tvo  exceptions:  (1)  the  technique  here  requires 

no  plane  wave  assumption  but  finds  the  ML  estimate  of  the 
more  general  time  delay  parameter,  from  which  one  can 
estimate  both  the  hyperbolic  LOP  and  source  bearing, 

(2)  the  derivation  here  does  not  constrain  the 
additive  noise  waveforms  at  different  sensors  to  have 
the  same  spectral  characteristics.  These  conditions 
allow  for  widely  spaced  sensors  since  the  spectral 
characteristics  of  the  noise  can  be  different  and  tho 
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signal  wavefront  la  not  .onstrained  to  be  planar. 

Having  derived  the  ML  estimate  of  time  delay, 
we  show  that  it  is  equivalent  to  the  GCC  function  with 
prefiltering  suggested  by  Hannan  and  Thomson  (1973). 

Although  the  ML  estimator  is  the  same  as  the  method 
suggested  by  Hannan  and  Thomson  (1973),  this  could 
not  have  been  accurately  predicted  ahead  of  time. 

The  Hannan  Thomson  (HT)  processor  was  obtained  as  a 
GCC  function  with  optimally  determined  weighting. 

In  related  work,  Clay,  Hlnich,  and  Shaman  (1973)  arrived 
at  a  less  general  ML  estimate  for  bearing,  due  to  the 
assumption  that  the  signal  spectral  characteristics 
were  flat  in  the  frequency  band  of  interest.  The  results 
of  this  thesis  are  also  more  general  than  those  of 
MacDonald  and  Schultheiss  (1969)  because  there  is 
no  signal  plane  wave  assumption  and  the  noise  spectral 
characteristics  can  differ  from  sensor  to  sensor. 

When  the  received  signal  and  noise  waveforms  are 
stationary  and  Gaussian  with  known  spectral  characteristics, 
it  is  shown  that  the  ML  estimate  of  time  delay  achieves 
the  Cramer-Rao  bound.  Thus,  the  ML  estimate,  in  this 
case,  achieves  a  variance  less  than  or  equal  to  that 
attained  by  any  other  means.  Two  realizations  of  the 
time  delay  estimate  are  given:  the  first,  uses  the 
GCC  function  with  appropriate  prefilters;  the  second 
appropriately  filters,  sums,  squares,  and  averages  as 
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suggested  by  Carter  and  Knapp  (1970a),  Further,  when 
the  spectral  characteristics  are  known  the  variance  of 
the  delay  estimates  is  derived  for  all  GCC  processors. 
When  the  signal  and  noise  spectral  characteristics  are 
unknown,  as  is  often  the  case  in  the  passive  bearing 
estimation  problem,  it  is  suggested  that  an  approximate 
technique  be  used,  whereby  estimates  of  the  ML  weighting 
are  inserted  in  the  place  of  the  correct  weighting. 

This  heuristic  procedure  will  converge  to  the  ML  estimate 
provided  the  weighting  is  properly  estimated.  The 
appendices  summarize  work  in  this  area  by  Carter,  Knapp, 
and  Muttall  (1973a)  to  estimate  the  spectral  densities 
including  coherence.  (Details  of  the  appendices  are 
discussed  later  in  the  introduction.) 

In  Chapter  4,  the  variances  of  six  proposed  time 
delay  estimates.  Including  ones  suggested  by  Roth  (1971) 
and  Carter,  Nuttall,  and  Cable  (1973),  are  compared  for 
an  example  case  where  the  signal  and  noise  have 
rectangular  spectra  with  different  bandwidths.  The 
results  confirm  the  advantages  of  ML  time  delay 
estimation. 

The  estimation  formulation  is  extended,  in  Chapter 
3,  to  three  important  generalizations:  multiple  sources, 
moving  source,  and  multiple  sensors.  The  multiple 
source  problem  introduces  a  new  term  in  the  award 
function  which  was  maximized  in  Chapter  3  to  obtain  a 
single  time  delay  estimate.  This  additional  term  is  the 
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information  between  two  proceeeea.  Nat  the  la  (1966), 
ualag  raaulta  of  Galfand  aad  Yagloa  (1959),  haa 
shown  the  Shannon  (1949)  dafinltion  of  Information  to 
ba  directly  related  to  the  coherence  between  two 
proeeeaes.  Thue,  aa  with  the  single  tine  delay 
••tiawtioa  problea,  coherence  plays  an  important  role. 
Source  motion  significantly  complicates  the  bearing 
estimation  problem  as  Indicated  in  section  B  of  Chapter  5. 
Indeed,  unless  soae  preprocessing  is  done,  the  received 
waveforms  appear  uncorrelated  despite  the  presence  of  a 
common  but  time  compressed  (or  leas  generally,  Doppler 
shifted)  signal.  A  method  baaed  on  the  ideae  of  Chapter 
3  Is  suggested  for  preprocessing  the  received  waveforms 
to  resnve  the  effect  of  source  motion.  The  last  section 


of  Chapter  5  extends  the  filter  aad  sum  realization  for 


time  delay  estimation  to  a  multiple  sensor  environment. 
Finally,  Chapter  6  is  a  brief  discussion  and  nummary  of 
applications  for  the  aethoda  of  time  delay  estimation 
and  suggestions  for  future  work. 

The  appendlcea  of  this  dissertation  are  provided  to 
lmolement  and  corroborate  the  theory  developed  in  Chapter  3. 
Appendix  A  summarizes  two  methods  of  spectral  estimation 
given  in  Carter,  Knapp,  and  Nuttall  (1973a)  and  Carter 
and  Knapp  (1975).  Appendix  B  gives  important  results 
of  the  statistical  behavior  of  the  estimates  of  the 
magnitude* squared  coherence  (BSC) , including  the 
probability  density  function  (pdf),  the  cumulative 
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distribution  fuse t loo  (odf ) ,  aad  th«  m-th  ROMat  of  the 
me  Mtiaata.  A  complete  discussion  of  the  blaa  and  the 
varluM  of  the  BBC  estimates  Is  presented,  including 
a  simulation  (dose  by  Butt all  aad  Carter  (1976b))  that 
supports  tboorotloal  rooulta  of  Baubrlch  (1966)  aad 
Cartor,  Knapp,  aad  Nut tall  (1973a)  aad  rofutos  past 
simulation  rooulta  of  Boalgaua  (1969a).  Qoiac  a  not bod 
suggested  by  Boalgaua  (1969a),  a  rodueod  bias  method 
of  M8C  estimation  ia  verified;  however,  It  la  diacovarad 
that  for  aaay  practical  estimation  altuatloaa  tha  raducad 
blaa  M8C  estimator  will  hava  lacraaaad  mean  aquara  arror 
(MBS)  abac  compared  with  tha  BBC  estimator  given  la 
Appendix  A.  An  exaaqple  la  glvaa  of  arroaoouo  alaiulatioo 
rooulta  (la  particular,  uaoxpoctodly  largo  blaa)  when 
tha  aaauaptloaa  of  tha  thoory  hava  booa  vlolatad. 

Ia  tha  procoaa  of  dotactlag  a  coharaat  source 
It  ia  doairablo  to  establish  a  throahold  above  which  a 
aourco  la  coaaldorad  dot acted.  Rules  for  aatabllshlag 
aucb  a  threshold  are  glvaa  (Cartor  (1976))  la  order  to 
achieve  a  specified  probability  of  falsa  alarm.  Having 
established  such  a  threshold,  it  la  possible  to  determine 
tha  probability  of  dotactlag  a  coherent  source;  the 
probability  of  detection  will  depend  both  on  the 
observation  time  aad  the  underlying  strength  of  the 
coherent  source.  Example  receiver  operating  character- 
iatics  are  plotted  for  different  observation  times  and 
coherent  source  levels. 
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Appendix  C  given  a  complete  PORTRAN  IV  computer 
listing  of  n  program  to  estimate  time  delay.  The 
program  was  successfully  compiled  and  run  on  both  a 
Uni  vac  aad  an  IBM  computer.  Appendix  D  presents  an 

txmplt  case  to  validate  both  the  theory  and  the  computer 
program. 

The  text,  then,  is  arranged  as  follows:  Chapter  3 
contains  the  derivation  for  the  ML  time  delay  estimator; 
because  these  results  depend  on  the  coherence  between 
two  random  processes,  we  first  demonstrate  in  Chapter  2 
what  characteristics  the  coherence  possesses.  Chapter  4 
compares  the  ML  estimator  derived  in  Chapter  3  with 
other  proposed  methods  for  estimating  time  delay. 

Chapter  5  extends  the  results  of  Chapter  3  to  three 
important  generalisations:  multiple  sources,  moving 
source f and  multiple  sensors.  Applications  and  a  general 
discussion  are  presented  in  Chapter  0.  The  four 
appendices  are  all  concerned  with  experimental 
verification  of  approximate  methods  for  estimating  time 
delay  presented  in  Chapter  3. 


U 


CHAPTER  2 


\ 


THEORY  AND  APPLICATIONS  OF  COHERENCE 


The  solution  to  the  physical  problem  of  estimating 
source  bearing  is  intimately  tied  to  the  coherence 
between  spatially  separated  passive  sensors. 

This  chapter  presents  the  definition  and  properties 
of  the  coherence  and  several  new  results  on  its  use. 

These  results  bear  both  directly  and  indirectly  on  the 
solution  to  the  optimum  delay  estimation  problem. 

2A.  Definition.  Relationship  to  Crosscorrelation,  and 

Properties 
2A1.  Definition 

The  coefficient  of  coherency  (CC)  between  two 
wide  sense  stationary  random  processes  is  the  normalized 
cross  power  spectral  density  function  defined  by  Weiner 


(1930)  as 


y x  x 
xlx2 


Gx  x 
xlx2 


(2-1) 


(f)  o  (f) 
X2X2 


where  f  denotes  the  frequency  (Hz),  G„  _  (f)  is  the  cross  - 

xlx2 

power  spectrum  between  x.(t)  and  x.(t),  and  G„  „  (f), 

Gx  x  (f)  denote  the  auto  power  spectra  of  x1(t),  x2(t). 

2  2 

respectively.  Despite  some  confusion  in  the  literature, 
Weiner  intended  for  the  CC  to  be  complex.  This  is 
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appurent  elncr  he  discusses  (p.  194,  Weiner  (1930)) 
both  the  modulus  and  the  argument  of  the  CC .  Moreover, 


In  suggesting  hoe  one  night  compute  the  CC,  the  modulus 
of  the  conplex  numerator  is  not  indicated.  The  CC  is 
also  referred  to  as  the  conplex  coherence  (Carter,  Knapp, 
and  Nuttall  (1973a)).  Many  of  the  results  which  follow 
depend  on  the  magnitude-squared  of  the  CC  (MSC).  The 
MSC  is  also  referred  to  as  the  squared  coherency 
(Jenkins  and  Watts  (1968)). 

In  order  to  simplify  the  notation  throughout 


the  thesis,  we  define 


:x  x  (,)  1  ?x  *  <n 
*1*2  *1*2 


(2-2) 


When  the  two  processes  under  consideration  are  apparent, 
we  further  simplify  the  notation  by  letting 
C(f)  s  C^f)  .  cia(«. 

The  magnitude  of  the  CC  (MC)  is  denoted  by 

lTVa<f>l  *  V  V,*'1  ' 

The  term  "coherence"  can  imply  CC,  MC  or  MSC.  Indeed, 
variables  that  are  a  function  of  the  MSC  (or  MC)  alone 
are  also  functions  of  the  CC  alone,  but  not  necessarily 
vice  versa.  While  it  seems  most  natural  mathematically 
to  refer  to  the  CC  as  the  coherence,  the  majority  of  the 
literature  refers  to  the  MSC  as  coherence. 


Since  0  (f)  and  G  (f)  are  real,  the  phase 

*1*1  *22 
of  the  CC  denoted  by 


♦_  -  (f)  -  Arg 
*1*2 


( 2-4a) 
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*  Ar«  [°*1*2<f)]  <2-4b) 
■  4r*  <2-4c) 

that  la,  the  phase  of  the  CC  la  the  same  as  the  phase  of 
the  cross  spectrum.  Later  we  will  interpret  (2-4c)  as 
the  phase  of  the  optimum  linear  filter  that  maps  x^(t) 
to  x2(t). 

2A2.  Relation  to  Crosscorrelation 
The  CC  between  x(t)  and  y(t)  can  be  confused  with 
the  crosscorrelation  coefficient  or  normalized  cross¬ 


correlation  function  defined  for  zero  mean  processes  by 


pxy(t> 


■w*> 

a„(°)  *yy(0) 


(2-5) 


The  normalized  crosscorrelation  is  a  function  of  lag  and 


not  frequency.  Further  note  that  the  normalizing  factor 
is  the  scalar J2XX(0)  Ryy(0)J*,  Independent  of  t.  It 
is  not  a  lag  dependent  normalization.  The  CC  has  an 
abscissa  dependent  type  of  normalization  (2-1). 

However,  there  are  two  models  of  filtering  that  aid  in 
interpreting  the  CC  as  a  type  of  crosscorrelation. 

In  the  first  model,  we  are  given  x(t)  and  y(t)  as 
depicted  in  Figure  2-1,  and  we  want  to  find  the  CC 
between  x(t)  and  y(t).  If  we  prefilter  x(t)  by  the 
linear  filter  H^(f)  and  y(t)  by  the  linear  H3(f),  then 
(from  p.  399,  Davenport  (1970))  the  cross  spectrum 
between  the  filter  outputs  is 

0  (f)  ’  G*y<f>  Hi(f)H2*(f)  (2-6) 


That  la,  tha  phaaa  betwaan  Input  procassas  Is  Invariant 
to  equlphase  flltarlnf.  Than,  to  cosiputa  tha  CC  between 
x(t)  and  y(t),  wa  coapute  tha  cross  spec t run  between 
Xj(t)  and  y^t).  This  could  be  accomplished  by  cross- 
correlatlnc  x1(t)  and  y1(t)  and  taking  the  inverse 
Fourier  transfora  (or  sea  Appendix  A). 

In  tha  second  nodal  used  to  understand  the  CC  we 


observe  that  for  x^t)  and  y1(t)  (in  Figure  2-1  )  zero 
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PX  y  <T> 


/.Gxy(f)Hl(f)H5(r)eJ2"rT  df 


lyl  r  • 

11  /  l 


.(2-11) 


Oxx(f)  H^f) 


df  iGyy(f) 


H2(f>r  df 


f* 


Thus  if 


H1(f)-H2(f)  -  fc-  ^<|f|<fc+  % 


,  elsewhere 


(2-11)  becomes  (for  small  Af) 

[°«<  v*«  •  vH* 


PX  V  ( 

xlyl 


Af 


Re 


°«<W,c> 


(2-12) 


(2-13a) 


( 2-13b) 


«*[v(,c)*J2W,cT] 


(2-13c) 


*  |yxy^*c^|  £°*  2w,c(T”D  >]  '  (2-13d) 

The  crosscorrelation  coefficient  at  zero  argument  is 
given  by 

^y^O)  -  •  (2-14) 

Thus  we  see  from  (2-14) and  (2-13d)  bow  the  CC  is 
related  to  the  crosscorrelation  coefficient. 

2A3.  Properties 

The  power  spectral  density  matrix  is  positive 
semldeflnlte  (Jenkins  and  Watts  (1968)).  Therefore, 
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for  two  random  processes,  we  see  that 


'Vf>! 


x  <f>  X  <f> 

xlxl  *1*2 

°x  x  <*>  G*_*  <f> 
X2X1  *2*2 


>  0 


(2-lSa) 


For  real  processes. G_  _  (f)  »  G*  _  (f)  and  thus 

X2X1  xlx2 


5x  x  (£)Gx  x 
xlxl  X2X2 


(f)  -I  G, 


X1X2 


(f>! 


>  o  , 


(2-15b) 


and 

Vi<f>0v»<<>  1  |0W,)|J-  <a*l*c) 

Further,  G„  _  <f)  and  Gv  v  (f)  are  nonnegative ,  real 

*2*2 

functions  of  f.  When  G  _  (f),  Gw  _  (f)  are  strictly 

xlxl  X2X2 

positive  definite  (that  is,  when  G_  _  (f)G_  _  (f)>0), 

xlxl  X2X2 

(2-lSc)  can  be  divided  through  by  G_  _  (f)Gv  (f) 

xlxl  X2X2 

without  changing  the  sense  of  the  inequality  thereby 
yielding 

C,  „  (f)  <  1,  Vf.  ( 2-10a) 

xlx2 


Further,  the  magnitude ■squared  of  any  complex  number  is 
greater  than  or  equal  to  zero.  Thus, 


0  <  c  .  (f)  <  1  .  (2- 16b) 

”  *lx2 

The  MSC  always  falls  between  zero  and  one.  Further, 
as  will  be  shown,  it  is  zero  if  the  processes  x^(t) 
and  Xg(t)  are  uncorrelated;  and,  it  Is  equal  to  unity 
if  there  exists  a  linear  relation  between  Xj(t)  and 
X2<t).  The  cross-power  spectrum  is  then  defined  by 


<n 


(1-1T) 


tf  ’  11  Tl  ft 

Mf  it  ft— —lag  tiw  it  ptlat*  «t  tiw 


rtf  tfa  tf  WK  It  ttitfltf  mr  tktt  mm  frftf 
rtf,  hnfetr,  If  tilt  f  tf  mm.  tf  ptwr  apMtrtl 
fMltf  Mtrf  f  tl—tltr.  Iff  )wnrtf  •#  tf  MK 

If  s(t)  U  fllttrf  f  «j(f)  Mi  r(t)  la  filttrf  f 
l^(f )  m  flttti  It  PIIWI  M,  tfa 


(2-18*) 


TB 1808 


l  Vf,l 

c*lFl(f)  “  o”(f)dyy(FJ 


J-iZ - '■  1  *  - 1 - «•  c  ff)(2-18b> 

C^(«)|I1(«)|S  0^(011,(01”  *y 


provided  |l1(f)|,|*J(f)|a  f  0 
C*l9lit}  "  CMy(t)  • 


(2-19) 


That  1*.  the  M8C  la  th«  *mm  between  x  and  y  aa 
between  tha  filtered  versions  and  pj. 

Mi  M  Coherence  FvucUqp 
Tha  NSC  function  for  tha  aero-naan,  side-sense 
atatloaary  proaesasa  a(t)  aad  y(t)  la  uaaful  la  aavaral 
Mya,  ahleh  will  ha  proved  la  tha  following  •action*. 

a 

FI rat,  for  two  ladapaadaat  proeaaaaa,  tha  M8C  function 
la  aaro.  faeaad.  tha  WC  eeasurea  tha  degree  of  system 
linearity.  Third,  under  tha  ass uapt loss  to  ba 
p  rasas  tad,  tha  MK  fuaetloa  serves  as  a  Shi  measure. 

211  Measure  of  Correlation 
‘HBOdlM  2-1:  If  two  xaro-maas  stationary  processes 
x(t)  aad  y(t)  are  Independent,  they  are  also  uncorrelated 
and  orthogonal; 

ft  (t)  •  I(x(t)y(t-T)l  •  «lx(t)|Ely(t-T)|  -  0.(2-20a) 

0  <f)  •  /  «__(T)e'jawfTdT  •  0  ,  ( 2-20b) 

•#  ** 


and  the  NSC 

C  <f)  -  0  ,  Vf  (2-200 

provided  CXJ|(  f)Gyy(  f)  +0. 
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lnc« ,  If  the  two  proctaata  arr  independent  (or 
uncorrelated)  with  zero  Mean,  the  M8C  between  them  la  * 
aero. 

DZtCOMIOII  Or  THBOHHI  2*1 :  Note  that  Jointly  Gaussian 

random  processes  that  are  uncorrelated  (incoherent) 

are  also  Independent.  However,  it  is  possible  for  two 

processes  to  be  highly  dependent  yet  uncorrelated 

(incoherent),  even  if  one  of  the  two  processes  is 

Gaussian.  Although  one  say  be  led  by  physical 

cons lderat ions  to  presume  processes  are  independent  and 

hence  uncorrelated,  in  practice,  it  is  easier  to  show 

processes  are  uncorrelated  than  independent .  Note  that 

if  Cxy(t)  -  0,  Ff.  it  follows  that  »elYxy(f)J- 

Xs(YXy(f))  ■  0  •  0xy(f),  Vf  and  thence  it  follows  that 

>Xy(T)  ■  0,  ft.  Hence ,  we  see  that  if  two  processes 

are  Incoherent,  then  they  are  also  ua correlated.  However, 

as  stated  earlier,  being  incoherent  does  not  necessarily 

isply  being  Independent.  For  example,  suppose 

y(t)  ■  n(x)  and  x(t)  is  a  aero  seas  stationary  random 

2 

Gaussian  process  with  variance  o  and  first  order 
probability  density  function  (pdf). 


then  from  Nuttall  (lPftt)  and  Carter  and  Knapp  (1975) 

Rxy(t)  -  K  1^(0,  (2-22) 


where 


K  -4  /  n(«>*  . c*x8/a°a  dx  .  (2-23) 

0  —  V  2*oa 

There  Tori?,  for  even  non  linearities,  K»0  a  ad  *xyCT)»0. 

Hence  0  (f)«0  and  C  (f)>0.  Thun,  It  la  aiiapla  to  derive 

mg  mg 

a  procans  y(t)  which  la  coapletely  dependant  on  x(  t ) 
but  which  is  ttacorrelated  with  it.  Hanes,  the  converse 
of  theorea  (2-1)  does  not  hold  and  coherence  does  not 
provide  Information  on  dependence  or  independence  but 
only  on  second  order  measures  like  correlation. 

2S2.  Measure  of  tystsa  Linearity 
The  MK  function  can  be  used  to  aeasure  systea 
linearity.  In  Figure  2-2  consider  the  linear  systsa 
with  Input  x(t),  lapulsc  response  h(t),  and  output  y(t). 
The  output  y(t)  is  expressed  by  the  convolution  Integral 

y(t)  -  /  h(T)x(t-t)  dt  ,  (2-24a) 

or 

y(t)  -  h(t)  •  n(t)  ,  ( 2-24b) 

where  •  denotes  convolution. 

In  the  Fourier  doaain  the  convolution  is  the  multi¬ 
plication  (Oppeabela  and  Schafer  (1975)) 

T(f)  -  M(f)I(f  )  ,  (2-25) 

where  X,  I,  and  Y  are  Fourier  transforms  of  x,  h  and 
y,  respectively. 


(2-26) 


If  *  ijritw  la  llaaar  than 

vXf(*)  •  •^*»(,)  .  f  f 

aad  hence 

CMf(t)  "  l*  Vf  (2-27) 

raoor  or  tkbo*im  3-2 


For  llaaar  systems, 


°yy(f)*V(  f)MJy(f)Cxx( '  >  Cxy<  f  >-%< f  >G«x<  f) 


(2-28) 


or  whaa  0__(f)  t  0 

0„(f)°*(f) 

Gwa(f)  -  -4- 

y  °M<,> 


°„(f). 


(2-29) 


Ssbetitutiag  0yy(f)  lato  tha  basic  daflaltioa  of  CC, 


v<*> 


iuili 


V  o„T<f)o;,(f) 


fyy(f)[  eJ>xy(f) 


V  |V*>| 


•  e^xy*** 


( 2-30a) 


( 2-30b) 


furthar , 


Cxy(f)  l|Y*y<f)|2  *  co«2  l  >Ry<f )l+»i«2l»Ky(f»  (2-31) 

DISCUSSION  or  TSIORIM  2-2:  This  theorem  la  ralatad  to 
work  of  Koopmans  (1964),  Janklas  and  Watts  (1968), 

Otaas  sad  laochson  (1972),  Carter,  Knapp  and  Nuttall 
(1973a).  Koopaaiaa  (1974),  Sri  1  linear  (1973),  and 
Halvorsen  aad  Banda t  (1973).  This  theorem,  experience, 
sad  certain  intuition  lead  one  to  believe  the  converse 
of  the  theorem  should  also  be  true.  To  date  no  proof 
has  been  presented  for  the  converse.  Notably,  it  is 
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tha  ooaverse  which  would  play  a  most  Important  rol •  in 
the  applleatloaa  araa.  Tbia  la  bocauaa  oaa  la  aaldoai 
gives  a  llaoar  system  aad  asked  to  measure  MtC .  Rather, 
oaa  la  gives  aa  ualdaatlflad  system  aad  aakad: 

"la  It  lla*art".  Ia  tha  paat.  If  tba  MSC  waa  ualty.  <>ne 
bad  a  "bunch"  that  tbia  waa  trua  but  ao  rigorous  proof 
aalatad  to  aaaart  tbia  truth.  Tha  following  theorem 
acta  to  clarify  this  dilemaui  aad  iadaad  show  what  can 
aad  what  eaaaot  ba  said  about  linaarlty  whan  tha  MSC 
la  ualty. 

Tba  atroagoat  tbaorao  which  can  ba  provad  in 
this  regard  la  aa  follows : 

TMOdlM  1-3:  If  CXy(f)al.Vf,  tbaa  with  probability  oaa 
there  aaiata  aa  optimum  filter  with  unique  traaafar 
fuactloa  l0if)  that  eaa  act  oa  tha  laput,  x(t),  to  aa 
ualdaatlflad  ay at am  to  achieve  output  yc(t)  exactly 
equal  in  every  detail  to  tha  output  y(t)  of  tha 
ualdaatlflad  syataai.  (that  la,  yQ(t)*y(t),  with 
probability  oaa).  Moreover,  tha  pbaaa  of  tha  filter 
Arg  Mo(f)  .  #yj|(fj  ■  Arg  y  yx<  f )  . 

In  order  to  prove  theorem  2-3,  It  la  necesaary  to  Introduce 

aad  prove  a  lsna. 

LEMMA  2-1:  If  G_.(f)  la  the  power  spectrum  of  an  argodlc 

wW 

random  procaaa  with  member  function  e(t)  and  if  G##(.f)»0, 
Vf,  than  e(t)  equals  zero  with  probability  one  for  all  t. 
PROOF  OF  LEMMA  2-1  From  p.  150,  Papoulls  (1965),  the 
Chebycheff  (or  Tchebycheff)  inequality  la 
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(2-32) 


M 


(|o(t)-«  fr(t)]  | <t)  >  1  -  -2.  , 

c 

c>0  mi  to  n4i  arbitrarily  mil  a  ad  o3  is  tha 
varlaaee  or  pmr  of  o(t).  Tto  autocorrelation  fuaetioa 
of  o(t)  is 


*oo(T)  "  *t. 


(2-33) 


bot  O^f)-©.  »f  ao  that  2##(»)*0.  Vt-  18  particular 

.  *^(0)  •  *[a*(t)]-0  •  a2  ♦  BS[o(t)]  •  (2-34) 

toooo  «*•©  nod  l[a(t)]*0.  Alternatively  aota  that  tto 
value  of  tto  tails  of  tto  autooorrolatioa  la  ralatatf  to 
tto  woo  value  of  tto  fuaetioa.  apoelfleally.  (p.  333. 

Papoolia  (IMA) ) 


*..<*>  *  ■*(•<*>] 

to  alaoo  •##(t)«0, 

lXm  •«.<*>  "  0  • 

T—  •* 


(2-35) 


( 2-36) 


it  follows  that 

**[0(0]  •  0.  (2-37) 

aad  thus  that 

*[e(t)]  •  0  .  (2-35) 

Therefore,  tto  Ctobyetoff  inequality  with  o3«0  and 
*[o(t)>  0  la 

Prob  [|e(t)  !<«]>,  1  .  ( 2-39a ) 


TB  ISM 


But  0  *  Frob[  ]<  1  M  that 

Brob  [|a(t)|<«  ]  -  1  ;  ( 3-39b) 

that  la,  tba  probability  that  |a(t)|  la  laaa  than  mm 
arbitrarily  aall  valua  la  on.  ftatlatically,  »a  aay 
that  tbia  mat  happtai  M«ltb  probability  oaa"  or  *• 
aay  that  it  bappaaa  "alooat  aural y."  So  abaa  tha  powr 
apactrua  flH(f)  of  tbla  raaSoa  procaoa  la  saro  for  all 
frauuaaciaa,  tbaa  a(t)-0  aitb  probability  oaa. 

discussion  or  mu*  i-i 

Tba  iatarpratai loa  of  tha  raaulta  eaa  ba 
aialaaSlag  for  traaaiaata  (aoaetatloaary  procaaaaa ) 

For  aaaapla.  aoaaiSar  (aaa,  for  aaaapla.  p.  f)  of  Uaa 
(1SS0)). 


W  £  a1(t)4t  -  1^(0)  -  £  °aa<f>  if  *  (a’40) 

Baa  elaarly  tbara  aaiata  a(t^  0  aoab  that 


+a  A  •*<*»<• 


o  . 


(S-41) 


For  aaaapla.  if  a  fiaita  aaargy  pulaa  laata  oaly  a  fao 
aacoaSa.  tbaa  tba  poaar  (or  "araraga"  aaargy)  ia  auch 
a  aoarapatltlra  pulaa  ia  aaro .  Tbia  ia  bacauaa 


lia  /  T  #*<t)  st 
T—  -T 

aqua la  aoaa  aoaaaro  eoaataat  aaargy  but 


Vi  A  £  •’<«>« 
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equals  uro;  beaee,  tbs  power  la  aero.  Traaaleat 
aituatiosa  of  this  type  ara  disallowed  by  tha  ergndtclty 
coaatralat  abieb  requires  statloaarlty .  (Krgodlc 


processes  ara  atatloaary  but  aot  aecesaarily  vice  varaa. ) 
Tba  aaaaaea  of  tba  proof  tboa  la  that  for  ergodlc  raadoe 
procaaaaa  alaoet  sorely  a(t)«0  la  that  frequeacy  brad 
•bora  0##( f )«0.  Tbla  la  a  reeeosable  practical  assiaaptioa; 
however .  It  abould  aot  ba  overlooked  that  tbara  axiata  a 
aoaatat loaary  claoo  of  procaaaaa  for  ablcb  tba  proof  of 
LttNA  1-1  Ooaa  aot  apply.  Vo  bow  procaad  with  tba  proof 
of  tbaoraai  1-1. 

PPOOT  or  TMM  1-1:  It  la  laetruetlve  to  vlsualia a 
tba  proof  aa  attaaptlag  to  aaloct  aa  optlaue  filter  aacb 
that  tba  alalaaa  aau  squared  error  (Mi)  la  achieved, 
ab ara  tba  error  aft)  la  befiaed  aa  eft)»y<t;-y0<t >. 
aa  abaaa  la  Plftra  1-9. 

Tba  aolatloa  will  aaba  ao  praaaeptloao  oa  tba 
origia  (aoarca)  of  y(t).  It  la  useful,  however .  to 
cavialoa  y(t)  aa  tba  atatloaary  output  of  aa  aaidaatifiad 
ay a tea  aa  depleted  la  Pleura  1-4;  aweb  a  aodal  la  a 
special  eaaa  of  Figure  3-9.  but  la  perbapa  a  wore  coaeon 
aystee  idaatl float loa  problee  Vbatbar  tba  error  aigaal 
a(t)  la  gaaaratad  f roe  Figure  3-3  or  Figure  3-4,  it 
followe  that  tba  total  power  la  gives  by 


/T/*  e2(t)dt  •  f  0^1  f>  df 
-T/a 


( 2-42 ) 


2 « 


T*  UU 


lo<>l  of  Krror  *o«ultlag  fro*  Linoar 
»Pf  ro«>  — t  loo  of  Noal lroarttr 


Figaro  1-4 
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All  porcr  aptctrt  have  the  property  that  they  are  non- 
segatlve.  The  Uaplicatlon  la  that  In  integrating  over 
tlM  interval  (-».•),  there  eill  be  no  portions  of 
GH(f)  that  will  "cancer'  other  portions.  Solving  for 
G^f),  it  eaa  be  shoes  that 

6es(f>-Cyy(,)  *  f  )  |l(  f  )  1 2-«(  f  )G  (f) 


xy' 

-H*(f)GJy(f), 


(2-43) 


which  can  be  written,  as  done  by  Carter  and  Knapp  (1975), 


as 


Cee(f >"°xx(,>|B(f)‘  2*4?;  |2K*,yy(f)[l-Cxy(f)].  (2-44) 


Since 


Ca*(f)  -  °*  °we(f)  i  °‘  Md  0  i  C*v(f)  -  1  • 


n 


*y 


it  la  necessary  to  sustains 

G  (f )  2 

'■<*> 


which  is  dose  by  selecting  the  optimum  linear  filter 

(2-45) 


°ex(,>  i°wx(f)l  1*  (f) 

Vf)  -nagm- •  Lffiriu  • 


xar~'  ~xx' 

The  optlaun  filter  is  a  Wiener  filter  and  is  discussed 
la  texts  by  Lee  (1960)  and  Van  Trees  (1968).  The  Fourier 
traasfora  of  (2-43)  is  the  impulse  response 

ho(T)  ’  £  «0<f)sJ3wfTdf  .  (2-46) 

la  general,  hQ(t)  el 11  be  a  nonsero  for  t<0;  hence, 
the  systsa  will  be  noarealisable.  Various  methods  can 
be  applied  to  obtain  the  optimum  realizable  linear  filter; 
although  they  are  beyond  the  scope  of  this  thesis,  they 
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are  discussed  in  standard  texts  such  as  Lee  (1960)  or 
Van  Trees  (1968). 

Prom  (2-45)  the  cross  spectrum  between  x(t)  and 

P(t), 

Gyx(f)  “  Ho(,)Cxx<f>’  <2-47) 

but  since  x(t)  excites  a  linear  filter  H0(f)  to  produce 
output  yo(t) ,  It  also  follows  that 

Gy  x<f>  “  Ho<f)Gxx<f)  ‘  (2-48> 

Substituting  (2-48)  into  .(2-47)  yields 

Gyx(f)  *  Gy0x(f)  •  (2-49) 

Since  y(t)«e(t)  ♦  yQ(t)  . 

Ryx(T)  “  [•<t)+yo(t)]x(t-T)l  (2-50a) 

•  Rex(t)  ♦  RyoX(t)  .  (2-50b) 

But  by  taking  the  Fourier  transform  of  both  sides  of 
(2-49) 

Ryx(T)  "  Ry0x^>  *  (2-51) 

Hence,  from  (2-51)  and  (2-50) 

Rex(T)  *  °-  Gex(f)'0;  (2-52) 

that  is,  the  error  is  uncorrelated  with  the  input  x(t). 
This  is  an  interesting  property  of  the  error  signal 
in  it's  own  right.  When  x,(t)  is  linearly  filtered 
by  Hi(f)  to  yield  y^t)  for  i*l,2,  the  cross-power 
spectrum  of  the  filter  outputs  is  given  by  Davenport 
(1970)  as 


rm  tut 


Va<0  "  Bi(f)ll5<r)C«1«a  (f)  (2-53) 


■mci  la  the  special  c»m  where  x1(t)-x(t),  x2(t)«e(t), 
■x(f)HI0(f)  ud  l3(f)-l.  it  follows  that 

°»o*<f>  "  B°<f>0**(f)  ‘  <2‘54> 

So  If  tho  arror  la  uacorrelated  with  x(t)  (that  is.  if 
C  (f)«0),  than  it  oust  be  true  that  G  (f)»0  (that  la, 
the  error  la  uncorrelated  with  the  output  of  the  optima* 
filter).  .The  wave fora  x(t)  being  uacorrelated  with  e(t) 
lap lies  that  e(t)  la  alao  uncorrelated  vlth  yQ(t). 
further , 


■ey(T)  “  I[e(t)r(t-T)]# 

but  y(t)-e(t)*yc(t)  ao  that 

R.y(t)  •  *{e(t)[e(t-t)  ♦  y0(t-t)]> 

-  R„Ct)  ♦  H  (T)  . 


Recognizing  that  R  (t)-0  and  taking  the  Fourier 

yo 

transform  of  both  aldea  of  (2-55)  yields 


(2-55a) 

(2-55b) 

(2-55c) 


°ey(f)  "  °ee<f)  *  (2-56) 

The  selection  of  the  optimum  H(f)  forces  (2-44)  to 
become 

Gee(f)  ’  °yy(f)[1  ‘  Cxy(f)]  *  <2-57) 


When  C„_(f)»l,  clearly  (from  2-57)  G__(f)"0,  and  thus 
xy 

(from  LEMMA  2-1)  e(t)«0  with  probability  one,  but 

y(t)  -  y0(t)  +  e(t),  (2-58) 

so  that  almost  surely, 


y(t)  -  yc(t) 


(2-59) 
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Thu*,  with  probability  on*,  the  linear  filter 

»0‘f)  ■  V”  ‘  <3‘60> 

will  operate  on  x(t)  to  achieve  y0(t)-y(t).  If  the 
optimum  output  y0(t)«*(t)  #  hQ(t)  then  by  the  Fourier 
transform  relation 

T0(f)  -  X(f)H0(f)  .  (2-81) 

The  Fourier  tranefora  la  a  one  for  one  reversible 

transformation  so  that  a  unique  x(t),  y(t)  implies  a 

unique  X(f),  T(f),  but  then 

VQ(f) 

Ho(f)  "  TTTT  (2-62) 

must  be  unique.  This  completes  the  proof  of  theorem  2-3. 
DISCUSSION  OF  THEOREM  2-3: 

Unique  transfer  functions  do  not  identify 
unique  systems.  Indeed,  nothing  is  known  about  the 
internal  structure  of  the  unidentified  system.  Further, 
the  fact  that  the  system  can  be  modeled  by  a  linear 
system  HQ(f)  such  that  when  both  (system  and  model)  are 
stimulated  by  an  excitation  x(t)  they  yield  identical 
output  y(t)  does  not  prove  that  the  system  is  linear 
over  all  inputs.  There  may  indeed  be  unobservable 
ndnllnearities  in  the  unidentified  system.  For  example, 
suppose  the  excitation  x(t)  is  stationary  but  with  first 
order  pdf  such  that  -A  <|x(t)|<A.  This  implies  that 
x(t)  never  excites  the  unidentified  system  for  amplitudes 
greater  than  A;  hence,  no  conclusions  can  be  drawn 
about  the  linearity  of  the  system  over  all  inputs. 


34 


« 


TR  5335 


Many  "real  world"  systems  are  linear  over  a  certain 
rango  of  amplitudes  and  then  saturate  above  that 
amplitude  as  in  the  caso  of  anuloR  computers 
(Kochen burger  (1972)).  As  another  example,  consider 
any  stationary  x(t).  The  stationary  excitation  has 
only  one  Invariant  power  spectrum  <*xx(f).  Systems 
which  appear  linear  for  some  Gxx(f)  but  which  are 
clearly  nonlinear  for  different  input  statistics  are 

simple  to  envision.  If  a  system  is  nonlinear  but  the 

*  • 

nonlinearity  is  not  excited  (or  more  generally,  not 
observed),  then  the  system  will  appear  linear  and  the 
measurement  of  the  MSC  will  equal  unity.  In  essence 
then,  the  class  of  nonlinear  functions  is  so  largo  that 
based  on  a  single  excitation  (even  white  Gaussian  noise) 
it  is  impossible  to  claim,  without  qualification,  that 
a  system  is  "linear"  simply  because  the  MSC  Is  unity,  for 
all  probed  frequencies.  Another  type  of  nonlinear  system 
is  one  in  which  the  MSC  is  observed  to  be  unity  in  some 
frequency  bands  and  not  unity  in  other  bands.  Thus 
yQ(t)  t  y(t),  unless  those  frequency  bands  which  cannot 
be  accounted  for  by  linear  processing  are  removed.  More 
precisely,  if  Cxy(f)  ■  1  in  the  frequency  band  (fj.fg) 
then  with  probability  one  there  exists  an  optimum  linear 
filter  with  unique  transfer  function  H0(f)  that  can 
act  on  x(t)  to  achieve  optimum  output  yQ(t)  where 
yQ(t)«y(t)  •  hj(t)  and  hj(t)  is  the  impulse  response  of 
an  ideal  zero  phase,  unity  gain  "box  car"  filter  that 
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passes  only  those  frequencies  tn  the  (fj.fj)  band- 
The  whole  problem  of  nonlinear  systems  can  be  treated 
by  considering  what  proportion  of  a  system  output  can 
bo  attributed  to  a  linear  operation  and  what  pro|K>rtlon 
is  due  to  a  residual  or  nonlinear  operation.  In 
general,  the  power  spectrum  of  the  optimum  output 


Vo(f>  “  |H°(f)l  Gxx(f) 


(2-63) 


or  substituting  (2-1),  (2-2)  and  (2-45)  into  (2-63)  yields 


S0y0(,)  ’  Gyy(,)C*y<,)  • 


(2-64) 


This  important  result  (Carter  and  Knapp  (1975))  can  be 


rewritten  as 

<Vf> 


°y  y  <f> 
*o7o 


(2-65) 


The  implication  is  that  the  MSC  measures  the  portion 

or  amount  of  power  (Gyy(f))  which  can  be  obtained  through 

optimal  linear  filtering  (in  the  MUSE  sense)  of  x(t). 

Moreover,  it  is  always  true  (provided  C  (f)  is  defined) 

*y 

that 

Gyy<f>  ■  Wn°yy(t)  *  [1-Cxy<f)]Gyy<f>  •  <2-66> 


Jffcv 


toft 


yields 


Substituting  from  (2-64)  and  (2-57)  into  (2-66) 


Gyy(f)  "  Gy0y0(f>  *  Gee(f)  *  (2_67) 

which  implies  the  power  spectrum  of  the  output  of  a 
system  is  comprised  only  of  the  sum  of  an  error  spectrum 
and  an  optimum  spectrum.  This  same  result  can  be 
noticed  from 
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Rvv(T>  "  R~<T>  *  ^  -<T>  *  R„«  <T>  ♦  K  w  (T)  • 

yy  ••  *Q*  eyD  yQyQ 

but  Rv  *(t)“r«¥  (-*>■<>. Vt  so  that 
yo  ro 

*„(r)  -  R  <t)  ♦  R  w  (t)  .  (2-69) 

yy  ••  y0y0 

Computing  the  Fourier  transfora  of  (2-69)  verifies 
(2-67). 

Just  as  the  MSC  measured  what  portion  of  Gyy(f) 
could  be  obtained  by  (optimal)  linear  filtering,  one 
minus  MSC  1st  a  measure  of  the  portion  of  output  power 
due  to  an  uncorrelated  error  component;  that  is, 

°ee(,) 

- 1  -  Vf>  *  <2“70> 

Thus,  it  follows  that  the  ratio  of  the  optimum  linear 
power  to  the  nonlinear  or  error  power  is 


Gy  y  (f) 

'0*0 


cxv<f> 

1  -<V'> 


(2-71) 


(This  ratio  will  be  Important  in  the  estimation  of  time 
delay. ) 

For  practical  nonlinear  systems,  the  identification  of 
the  optimum  linear  component  is  not  always  obvious. 

For  example,  in  the  system  without  noise  described  by 
y(t)»x3(t)+b  x(t),  the  optimal  linear  part  Is  not  bx(t). 
To  clarify  this  point,  it  will  be  demonstrated  that  for 
a  limited  class  of  inputs  and  a  limited  class  of  non- 
linearities,  analytic  expressions  for  the  optimal  linear 
part  can  be  obtained.  This  offers  interesting  insight 
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iato  both  tbo  general  syotm  ldoatl  float  ion  p  rob  1m  and 
tho  oohoroaca  latarpratatlon  problM.  First,  tbo 


nonlinearity  is  oosstralssd  to  bars  no  memory  and  no 
aoiso,  that  is,y«n(x) .  *  Second,  tho  input  procossoo  am 
eosstralaod  to  hs  soparablo  la  tbo  aoaso  doflnod  by 
Rattall  (196t).  A  soparablo  procoss  with  second-order 
pdf  ptx^.XgiT)  and  man  u  is  doflnod  as  ono  for  which 
tbo  Integral  /*(Xfu)p(x1,x2;T)dx1  aoparatos  Into  tbo 
product  of  a  function  of  x2  alono  and  a  function  of 
t  alono.  For  example,  it  can  bo  sbown  that  a  Gaussian 
procoss  posaossos  tboso  proport ios  and,  bonco,  is  a 
soparablo  procoss. 

Oador  tbo  no-nonory  nonl inoar ity  and  soparablo 
procoss  constraints,  it  baa  boon  proved  by  Ifuttall  (1958) 
tbo  crosscorrelation  between  x(t)  and  y(t)  at  delay  t  Is 
given  by 

Byx<T)  -  *  •  »  (2- 72a) 

whore 

i  • 

R  ■  -*  /  n(x)(x-u)p(x)dx  ,  (2-72b) 

a  -• 

p(x)  is  tbo  first-order  pdf  of  x(t),  n(x)  is  a  complete 

description  of  tbo  no-aenory  nonlinear  function,  and 
2 

o  is  tbo  variance  of  x(t).  Notice  that  the  constant  K 
does  not  depend  on  frequency  or  delay  but  only  on  tbo 
first-order  pdf  and  the  nonlinearity.  It  follows  directly 
from  (2-72a)  that,  for  no-memory  nonlinearities  excited 
by  separable  processes, 
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V(f)  “  Y*y(f)  •  «  re? 

V  °yy( 


77T 

n 


CompurtMon  of  (2-73)  with  (2-45)  and  (2-1)  hHows  ihni 
th«  conxtant  K  la  the  optima  linear  filter  In  the 

MM8K  sense. 


As  an  example,  suppose  x(t)  has  a  Gaussian 


zero-mean,  o—  variance  pdf;  then 

K  ■  4  /  n(x)x 
o 2  -- 


i—  -x2/2°2dx. 

V  2woa 


(2-74) 


Whenever  the  pdf  Is  even  and  n(x)  is  an  even  function, 
K“0  so  that  the  coherence  Is  zero.  However,  when  n(x) 
is  an  odd  function,  K  does  not  necessarily  equal  zero 


even  though  the  unidentified  system  is  nonlinear.  For 


example,  when  n(x)-x  (t)+b x (t) ,  application  of  (2-74) 


2 

yields  K-3o  +b.  Therefore,  the  optimal  linear  part  of 


x3(t)+bx(t)  is  not  bx(t)  but  rather  y0(t)«(b+3o2)x(t) 


for  a  zero  mean  Gaussian  process  with  variance  of  a  . 


For  b"0,  it  follows  that  X  f  0  and  C  (f)  f  0  provided 

*y 


G„(f)  t  0.  However,  if  b«-3o  ,  then  K«0  and  Cxy(f)*0. 


Thus,  the  HSC  may  still  be  zero  even  though  the  non¬ 
linearity  is  not  even.  A  computer  simulation  of  the 
example  with  o2  ■  Vg  and  b«-  WM  conducted,  and  the 
results  verified  the  theory  (Carter  and  Knapp  (1975)). 


This  result  can  be  independently  verified  by  calculating 
R  (t)  ■  E<x(t)[x3(t-T)+bx(t-T)]>,  which  for  Gaussian 


processes  is  3o  R  (t)+bR  (t).  Therefore,  C  (f)«0  if 


b«-3o  ,  and  there  is  no  power  in  the  optimum  linear  part 
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of  tho  nonlinearity  n(x)  «  x(t )  -  3o3x(t). 


Parenthetically ,  wo  aoto  that  aaothor  approach 


to  thia  problem  la  to  oxpand  tho  no  memory  nonlinearity 


fi  a«  an  Infinite  aerie*  of  orthogonal  polynomials. 


spec  i  f  i  <*a  1 1  y , 


t)  -  n[x(t>]  ■  r.  a  H  [x(t>]  . 
n«o  n 


(2-75a) 


where  the  H  (x)  are  t»  Herralto  polynomials  (see,  for 
n 


example,'  p.  xxxv,  Gradshteyn  and  Ryzhik  ( 1965) ) 


H  (x)»l,  H  (x)«x.  H  (x)-x2-l,  H  (x)«x3-3x 
°o  el  2  *3 


and  in  general 


(x)-xH  (x)-nH  (x) 
°n+l  4n  en-l 


(2-75b) 


Then,  tho  crosscorrelat ion  between  x  and  y  is  given  by 


Rxv<  !)  *  Y  anE{x(t)Hc*  [*<*-'>]} 


( 2-7G ) 


The  advantage  to  this  method  Is  that,  if  the  family  of 


correlations 


RxH  (*)<’>  *  E(x( t )Hg  [x(t-t)]},  n*l ,2 , . . .  (2-77) 


had  been  computed  once,  orthogonal  expansion  of  n(x) 


makes  R  (t )  immediately  apparent  by  a  simple  weighted 
xy 


summation . 


It  is  perhaps  germane  to  clarify  the  significance 


of  knowing  that  the  MSC  is  unity.  Just  as  C  (f)*l  for 

xy 


all  f  ensured  that  there  was  some  linear  filter  that 


mapped  x(t)  into  y0(t)»y(t)  exactly,  there  also  exists 


a  linear  filter  which  maps  y(t)  into  x(t)  exactly.  That 


IW 


Vf  >  <  iV 


if  ‘ 


V* 


V.»’Av 


**,**».. 


>,»s 


In,  sine*  |Oxy(f)|2  •  |Gyx<f)|2.  Cxy(f)  -  Cyx(f)  and 

conclusions  drawn  with  rsgard  to  x(t)  and  y(t)  have 
an  analogous  relation  bstwssn  y(t)  and  x(t).  Thus, 
svsn  though  on#  cannot  make  unqualified  statements 
about  the  unidentified  system,  there  certainly  exists 
a  total  detailed  knowledge  of  its  output  for  a  given 
input  and  therefore,  all  of  its  output  statistics  when 
the  MSC  is  unity  and  the  input  remains  unchanged.  All 
this  is  accomplished  through  the  utilization  of  a 
linear  (though  not  necessarily  realizable)  model. 

2B3.  Measure  of  Signal-to-Noise  Ratio 

The  coherence  can  be  used  for  determining  SNR 
as  will  be  discussed  in  this  section.  The  results  of 
this  section  are  of  interest  from  two  points  of  view. 

First,  the  SNR  is  a  fundamental  concern  in  the  basic 
passive  detection  problem  and  parameter  estimation  problem, 
and  second  the  results  of  this  section  will  aid  in  the 
Interpretation  of  optimum  delay  estimation  and  variance 
of  the  estimate  of  coherence  phase.  Hence,  while  these 
results  can  be  derived  independent  of  the  time  delay 
estimation  problem,  they  will  form  an  important  role  in 
the  understanding  of  how  to  estimate  time  delay  or 
source  bearing. 

When  x(t)  is  linearly  filtered  to  yield  output 
y(t)  and  the  output  is  corrupted  by  uncorrelated  additive 
noise,  as  depicted  in  Figure  2-5,  then  the  noise  power 
spectrum  is 


<2-79 ) 


«„(»•«„(*>[»-  v°] 

nil  la  aa  Intuitively  satisfying  raault  alaca  the  ISC 

la  salty  It  tbara  la  ao  aolaa,  whereas  tha  ISC  la  saro 

when  tha  output  la  all  aolaa.  For  liaaar  systems, 

additive  aolaa  uacorrelated  with  tha  laput  raduoaa  tha 

ISC  according  to  tha  ratio  of  0(f)  to  G„„(f). 

bb  yy 

Maaauraaaat  of  0..(f)  la  uaaful  oot  only  la  tba  image 

Bn 

processing  problem  dlacuaaad  by  Cbbbod  (1974)  but  also 

la  atudylsg  tha  gross  af facta  of  digital  flltariag  whan 

viewed  aa  a  par fact  f 11 tar  plua  addltlva  aolaa  (James 

(1979)  and  Valnatain  and  Oppaobala  (1969)).  Thaaa 

methods  can  alao  ba  appllad  to  atudylng  apacial  problems 

such  oh  faat  Fourlar  traoafora  (FTT)  aolaa  (Parrla  and 
Nut tall  (1971)  aad  Babiaar  aad  Radar  (1972)). 

Tba  povar  a pact  nun  from  tba  output  of  an  arbitrury 

a y n ten  can  alaraya  ba  vlevad  la  terms  of  lta  two  components 

Gyy(f)Cxy(,)  *nd  Gyy(f)[1-Cxy(f  j]  of  how 

G  (f)  la  produced  (a a  long  as  C  (f)  la  defined).  It  is 
yy  *y 

interesting  to  note  that  the  ratio  of  tbeae  components 


'Vo1'1  _  °z*<f>  _  Cxv<f> 

i  -c~Ui 


(2-79) 


can  be  considered  as  either  the  SNR  or  the  linear-to 


nonlinear  ratio,  depending  on  the  application. 

For  situations  Ilka  those  shown  in  Figure  2-5, 
the  coherence  measures  what  proportion  of  an  unidentified 
system  output  is  ’’linear."  Through  the  use  of  (2-79), 
the  MSC  provides  a  comparison  of  the  proportion  of  system 


TV 


it  that  la  11 


with  ths  proport loa  that  la 


aoallswar  la  exactly  tha  aaaa  way  la  which  tha  SMI 
mm  —a wa rod  for  tha  output  of  a  linear  system  corrupted 
by  additive  aoisa.  Bo  waver ,  la  othar  system 
ooafiguratioas,  aaeh  aa  that  ahowa  la  Pl|vrt  2-6.  where 
aolaa  aad  signal  bare  a  dlffaraat  interpretation, 
relation  (2-76)  will  not  be  uaaful.  Pi pure  2-6  is  of 
lataraat  to  tha  aoaar  community  alnca  it  la  analogous 
to  tha  phyalcal  situation  In  which  signal  a(t)  from  an 
acoustic  source  is  received  at  two  geographically 
asperated  sensors.  Bach  observed  signal  is  corrupted 
by  additive  stationary  noise  aad  is  linearly  filtered. 
When  n^t)  aad  n2(t)  are  uncorrelated  but  have  the  same 
power  spectra  Gn||(f).  the  SHI.  <*Bm( * ) /<>aa( * >  readily 

shown  to  be 


o..(o  y  e„m 


(2-80) 


which  differs  from  (2-79).  (Note  from  (2-19)  that 

C  (f)-C  (f).)  Ironically  it  will  turn  out  to  bo 

rlr2  x” 

(2-7%)  and  not  (2-80)  which  is  critical  to  our  problem. 

In  cases  where  each  transmission  path  attenuates  the 

source  signal  differently,  the  model  must  be  changed 

to  reflect  an  attenuation  in  one  channel.  Unless 

simplifying  assumptions  are  employed,  the  net  result 

is  that  G  (f)/G  (f)  cannot  be  determined  from  C  (f) 

ss  nn  xy 

unless  attenuation  in  each  path  is  known.  (See 
section  4  of  appendix  B.) 
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More  generally ,  the  aource  ia  transmitted 


through  two  ocean  medium  operators  H1(f)  and  H2(f) 
aa  shown  in  Figure  2-7,  which  can  attenuate  the  signal 
differently  at  different  frequencies.  For  illustrative 
purposes,  we  assume  that  the  ocean  medium  operators  are 
linear  time  invariant  filters.  Thus  s^t)  and  s2(t) 
are  the  outputs  of  filters  H^Cf)  and  H2(f),  respectively, 
which  have  been  excited  by  source  s(t).  This  model  of 
linear  filters  and  noise  is  mathematically  tractable 
and  has  been  proposed  before,  as  for  example,  on 
p.  389  of  Vhalen  (1971).  (More  sophisticated  models  are 
given  by  Kennedy  (1989).)  When  the  noise  ni(t)  is 
uncorrelated  with  the  signal  s1(t),  the  power  spectral 
density  at  the  output  of  the  i-th  sensor  is  given  by 

°*i*i(f>  "  °ss(,),Hi<f)l2  *  °n1n1(f)'  1-1 • 2  (2-81a) 

-  0.  _  (f)  ♦  G  _  (f).  i-1,2  .  (2-81b) 

■i"i  °iBi 

Further,  the  ratio  of  the  power  at  the  output  of  the 
filter  to  the  corruptive  noise  power  depends  on  the  MSC 
between  the  source  and  the  sensor .  Specifically,  from 
equation  (8)  of  Carter,  Knapp  and  Nuttall  (1973a)  or 


;»v*Y> 

m 

V  I 

•W- 
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Xj^t)  and  x2(t)  in  Figure  2-7  when  and  ( t )  and 

n2(t)  are  uneorrelated  is  given  by 


'x.x 


1*2 


<f) 


G.a(,)Hl(,)H5(f) 

" /  6x-;Tf  5sx  x  ^n 
t  *1*1  x2*2 


(2-83) 


In  order  to  relate  this  result  to  the  coherence 
between  the  source  and  each  sensor,  note  that. 


omH^o 


-Y“im  'v1!^rT5Tv77T ' i’1,2- 

so  that 

Taking  the  magnitude-squared  yields 

CXlx2<f>  "  X^ex^O  . 


(2-84) 


(2-85) 


(2-86) 


Thus,  when  a  source  drives  two  linear  time  invariant 
filters  whose  output  is  observed  in  the  presence  of 
uncorrelated  noise,  the  MSC  between  the  outputs  can 
be  no  larger  than  the  MSC  between  the  source  and  any 
sensor.  In  particular,  for  two  sensors  the  MSC  is 
the  product  of  the  two  source  MSCs,  as  given  in  (2-86). 
However,  it  is  possible  to  have  a  source  transmitted 
through  some  nonlinearity  such  that  the  MSC  between 
s(t)  and  x^(t)  is  low  and  the  MSC  between  s(t)  and 
x2(t)  is  low  and  the  MSC  between  x^(t)  and  x2(t)  is  high. 
For  example, suppose  s(t)  is  a  member  function  of  a 

stationary  random  process  which  is  separable  in  the 

2 

Nuttall  sense.  Then  the  MSC  between  x^(t)  *  s  (t)  and 
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s(t)  is  zero;  similarly,  the  MSC  between  x2(t)  -  s2(t) 
and  s(t)  is  zero;  however,  for  this  example,  the  MSC 
between  x^Ct)  and  Xg(t)  is  unity.  Thus, care  should 
be  used  in  interpreting  these  results  since  they  apply 
only  to  the  case  where  the  medium  can  be  accurately 
modeled  by  linear  time  invariant  filters  corrupted  by 
uncorrelated  additive  noise. 

Using  (2-86)  we  can  compute  a  SNR  squared  quantity. 


namely, 


ca  ,  <*> 
*1*1 


TT)  ’  S 


G.  ,  <*> 

s2s2 


Cx  X  (f> 
xl*  2 


.  (2-87) 


n2n2 


™  [l-C«x1(,?[1-C«2(f)] 


To  be  useful  (2-87)  requires  knowledge  of  the  source  to 

sensor  USCs.  However, if  C  (f)  »  C  (f)  "fc  ,  (f)]*, 

■*1  L  *ix2  J 

then  it  follows  that 


Ss  s  (f)Gs  s  (f) 
*1*1  *2*2 


nlnl 


TTOmty 


n2n2 


777 


V5 


777 


“2 


(2-88) 


The  results  on  coherence  from  this  chapter  will 
add  to  the  understanding  of  the  role  of  coherence  In 
ML  estimation  of  time  delay  as  will  be  seen  in  the  next 
chapter. 


49 


TR  5935 


CHAPTER  3 

MAXIMUM  LIKELIHOOD  ESTIMATE  OP  TIME  DELAY 

In  the  first  section  of  this  chapter  an  ML 
estimator  is  derived  for  determining  time  delay  between 
signals  received  at  two  spatially  separated  sensors  in 
the  presence  of  uncorrelated  noise.  This  ML  estimator 
can  be  realised  as  a  pair  of  receiver  prefilters  followed 
by  a  croascorrelator.  The  time  argument  at  which  the 
correlator  achieves  a  maximum  is  the  delay  estimate. 

In  the  second  section  of  this  chapter,  the  variance  of 
the  time  delay  estimate  is  derived  and  compared  with 
the  Cramer- Rao  lower  bound,  and  in  the  final  section, 
various  realizations  of  the  processor  are  considered. 

3A.  Derivation 

For  the  purposes  of  the  derivation,  a  signal 
emanating  from  an  acoustic  source  and  monitored  in  the 
presence  of  noise  at  two  spatially  separated  sensors 
can  be  mathematically  modeled  as  depicted  in  Figure  3-1. 
Mathematically, 

xl(t)«8i(t)+ni(t)  (3-la) 

x2(t)»as1(t+D)+n2(t)  ,  ( 3-1 h) 

where  Sj^t),  n^(t),  and  n2(t)  are  real,  Jointly  stationary 


SO 


random  processes.  The  delay,  n,  in  the  unknown  paramo tor 
to  ba  astlmatad.  Signal  a^Ct)  la  assumed  to  be 
uncorrelated  with  nolaa  n^(t)  and  n2(t).  Later  we  also 
assume  n^(t)  and  n2(t)  are  uncorrelated  with  each  other. 

More  generally,  It  may  be  asauamd  that  a2(t) 

Is  linearly  related  to  Sj(t)  by  the  transfer  function 
H(f)«|o(f)|e“^awf® ..  Thus,  unlike  (3-1)  where  the 
Fourier  transform  of  the  system  output  is  as^fje  *^2wfD  » 
the  output  transform  in  this  case  is  |a(f ’>  Is^f  )e'"'*2l,*D‘ 
The'  linear  phase  characteristic  of  such  a  system  is 
assured  when  the  impulse  response  Is  symmetric  about 
t»D.  For  realisable  systems,  this  implies  that  the 
duration  of  the  impulse  response  must  be  finite.  Thus, 
in  a  sense,  we  are  estimating  the  midpoint  of  a  symmetric 
finite  impulse  response  (FIR)  filter  depicted  in 
Figure  3-2a.  Such  an  impulse  response  is  not  necessarily 
peaked  at  D  (as  for  exsmple  in  Figure  3-2b).  In  the  . 
derivation  which  follows,  then,  a  can  (more  generally)  be 
interpreted  as  a  frequency  dependent  attenuation  |a(f)|. 

There  are  many  applications  in  which  it  is  of 
interest  to  estimate  the  delay  D.  This  chapter  derives 
an  RL  estimator  and  evaluates  its  variance.  Chapter  4 
compares  the  estimator  with  other  similar  techniques. 
While  the  model  of  the  physical  phenomena,  presumes 
stationarity,  the  techniques  to  be  developed  herein  may 
be  employed  in  slowly  varying  environments  where  the 
characteristics  of  the  signal  and  noise  remain 


stationary  only  for  finite*  observation  Lime  T.  Further, 
tbs  delay  D  and  attenuation  a  may  also  change  slowly. 

The  estimator  is  therefore  constrained  to  operate  on 
observations  of  a  finite  duration.  Having  estimated  the 
delay,  an  estimate  of  the  bearing  may  be  obtained  by 
mapping  the  delay  estimate  according  to  (Nuttall,  Carter 
and  Montavon  (1974)) 

0  «  arc  cos  ■  ,  (3-2) 

where  i  is  the  nominal  speed  of  sound  in  the  non- 
dispersive  medium  and  d  is  the  sensor  separation. 

(See  pp.  93-103  of  Urlck  (1967X)  A  rigorous  derivation 
for  the  ML  estimator  of  D  using  the  mathematical  model 
(3-la)  and  (3-lb)  requires  that  signal  and  noise  spectra 
be  given  (that  is,  known).  (See  Hannan  and  Thomson 
(1971).)  When  they  are  unknown,  a  heuristic  procedure 
of  estimating  these  spectral  characteristics  is  suggested. 
The  ML  estimator  of  delay  can  be  realized  as  a  pair  of 
receiver  prefilters  followed  by  a  .crosscorrelator .  The 
time  argument  at  which  the  correlator  achieves  a  maximum 
is  the  delay  estimate.  Qualitatively,  the  role  of  the 
prefilters  is  to  weight  the  signal  passed  to  the 
correlator  according  to  the  strength  of  the  coherence 
function.  This  weighting  turns  out  to  be  equivalent  to 
that  proposed  by  Hannan  and  Thomson  (1973)  and  under 
simplifying  assumptions  to  that  proposed  by  MacDonald 
and  Schultheiss  (1969),but  apparently  differs  from  the 
results  of  Clay,  Hinich  and  Shaman  (1973).  However,  the 
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development  presented  here  does  not  presume  Initially 
that  the  estimator  Is  a  GCC  function.  Rather,  it  is 
shown  that  the  ML  estimate  may  be  realized  by  prefiltering 
and  crosscorrelatlng  the  data  xl(t)  and  x2(t).  Indeed, 
other  realisations  of  the  ML  processor  are  also  possible. 
(See  section  3C  of  this  chapter.)  Por  example,  the  data 
can  be  appropriately  filtered,  summed,  squared  and 
averaged  In  order  to  estimate  the  delay.  This  latter 
processor  follows  directly  from  the  derivation  presented 
here  and  is  discussed  fully  in  3C. 

To  make  the  model  (3-1)  mathematically  tractable, 
it  Is  necessary  to  assume  that  s^t),  n^t)  and  n2(t) 
are  Gaussian.  Denote  the  Fourier  coefficients  of  x1(t) 
as 

Xi(k)  "  *  fJ  *i<t)e-Jkt*Adt.  (3-3a) 

where 


Note  that  the  linear  transformation  Xi(k)  is  Gaussian 
since  x^(t)  Is  Gaussian.  In  practice,  the  Integral  will 
be  replaced  by  a  discrete  Fourier  transform  (DFT)  or 
FFT.  When  the  number  of  data  points  in  each  FFT  is  large 
(as  will  usually  be  the  case)  then,  by  a  central  limit 
theorem  argument,  Xi(k)  will  tend  toward  being  Gaussian 
even  if  the  x^(t)  are  not  Gaussian.1,  This  presumption 

^These  observations  were  brought  to  the  authors 
attention  by  Dr.  G.  Mohnkern  of  the  Naval  Undersea  Center, 
San  Diego,  California. 


55 


TB  5335 


is  born#' out  by  Benignus  (1969b).  Hence,  the 
requirement  that  Sj(t),  n1(t)  and  n2(t)  be  Gaussian 
is  not  a  strong  requirement. 

As  the  observation  time  T-*», 

T  Xj  (*)  ♦  XjOcw^)  , 

where  Xj  is  the  Fourier  transform  of  x^t).  A  more 
complete  discussion  on  Fourier  transforms  and  their 
convergence  is  given  in  Davenport  (1970),  Jenkins  and 
Watts  (1968),  Koopmans  (1974),  Otnes  and  Enochson  (1972), 
Bendat  and  Piersol  (1971)  and  Bril linger  (1975).  From 
MacDonald  and  Schultheiss  (1969),  it  follows  for  T  large 
compared  with  |D|  plus  the  correlation  time  of  R  (t), 

8«  S'* 


that 


E  [X1(k)XJ(i)] 


1  r 

T  uXjX2(ku>A),  k»£ 
0  ,  kfl 


(3-4) 


Note  that  EfX^k)]-  E{xt(t)J  -0,  i-1,2. 
Now  let  the  vector 

X(k)  -  [x1(k),X2(k)J  ’  , 


(3-5) 


where 

is 


denotes  transpose.  Then  the  covariance  of  XUO 


E 


£x(k)X*  (k)j  -E 


X1(k)X{(k)  X:(k)X|(k) 
X2(k)XJ(k)  X2(k)X|(k) 


(3-6) 
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r 


«  J_ 

°x1x1<k“A>  OxjXjC'V 

T 

_<V2(kV  °x2x2<k“A>. 

4  4  VV  1 

(3-7) 


(3-8) 


where  Qx(u»)  is  the  spect  ral  matrix  of  ( t ) , x2( t )J  . 

The  vectors  X(k),  k*-N,-N+l . N  are,  as  a 

consequence  of  (3-4),  uncor related  Gaussian  (hence, 
Independent)  random  variables.  More  explicitly,  the 


pdf  for  X  =  X(-N) ,X(-N+1) , . . . ,X(N) ,  given  attenuation 
a  and  delay  D  is1 

p(X|a ,D)  -  hexp  -  |  Jj  .  (3-9) 

where 

-  r  X  (k)Q  A(kuA)X(k)T  (3-10) 

k— N 

and  h  Is  a  function  of  |Qx(ku>A)|  (Van  Trees  (1968)). 
Replacing  TX^(k)  by  X1(kuA),  the  Fourier  transform  of 
Xjd),  it  follows  from  (3-10)  that 

Jx  -  E  X*'(ku)A)Qx1(kuiA)X(ka>A)i  .  (3-11) 

k=-N 


The  ML  estimate  of  D  (see,  for  example,  Jenkins  and  Watts 
(1968)  or  Van  Trees  (1968))  is  the  value  of  D  which 
maximizes  p(X|a,D). 


*More  explicitly,  since  the  density  function  depends 
on  Q  ,  one  could  write  p(X|a,Q  ).  This  notation  obscures 
the  role  of  the  delay  but~clarif ies  the  need  to  know  (or 
estimate)  signal  and  noise  spectra.  Further,  if  a»|o(f)| 
then  the  pdf  is  conditioned  on  knowing  |a(ku>.)|,  k*-N, 

-N+l . N. 
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In  general,  the  parameter  D  affects  both  h  and 
In  (3-0).  However,  for  uncorrelated  noise  in  (3-1), 
h  is  independent  of  the  delay. 

For  large  T,  (3-11)  becomes 

*  /  X*'(f)Qx“1(f)X(f)df  .  (3-12) 

From  (3-0) -(3-8) , 


‘O' 


fa  -  (f>  -o_  .  (O  1 

*2*2  *1*2 

i 

v1(r,s«2(,,-|v2(f)|2 

Hlg1  (W  i  (3-13b 

1  12  J  J. 


C12(f)  01;  that  is,  x1(t)  and  x2(t)  cannot  be  obtained 
perfectly  from  one  another  by  linear  filtering 
(Carter  and  Knapp  (1975)),  or  equivalently  for  the  model 
(3-1)  that  observation  noise  is  present. 


When  C  (f)-Gn  (f)-0 
nln2  nln2 

°x  x  (,)"°s  s  ff)+Gn  n  (f>  • 
xlxl  8181  nlnl 

°x  X  8  (f)^n  n  <f>  • 

X2X2  8181  n2n2 


(3-14a) 


(3-14b) 
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0  ( f )"aG  (f )  e 

xlx2  "l"l 


-12* ro 


Cla(f)-a*G 


s  •  (,)/Gx  x 
*1*1  1  xlxl 


(f)G,  x  (f). 

X2X2 


(3-140 


( 3-i4d ) 


and  it  follows  that 

Jx  -  /  X*,(f)Q^1(f)X(f)df-J2+J3  . 

where 


2  “V" 

/  A(f)+A*(f)  df, 

Gx*x  (f) 

A<n’**<0*n ' ^fxT^^TTT^m, ' 


CJ-tf.a) 


( n-isb) 


(3-15c) 


(3-15d) 


In  order  to  relate  these  results  to  Hannan  and 
Thoaison  (1973)  and  others  and  Interpret  how  to  implement 
the  ML  estimation  technique  note  that  for  x^t)  and 

x2(t)  real  A*(f)-A(-f).  Then  (3-15c)  can  be  rewritten  as 

.  •  • 

-J,-  /  A(f )df+  /  A(-f)df-2/  A( f )df  .  (3-16) 

J  .•  -«• 

Letting  TG  ,  <f)Ax.(f )x!(f),  (3-16)and  (3-15d)  can  be 
xlx2  1  2 


written  as 


-J,-2T  /  G  ( i  Jtw - 77T1  - 

3  —  xlx2  |Gx1x2(f,|  ll-Cl2(f)I 


<f) 


Cll(±l  .J2-TO  df.  (3.17) 


Notice  that  the  ML  estimator  for  D  will  minimize 
3l"**2+33’  **ut  ***•  •®l®ction  of  D  has  no  effect  on  J2- 
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Thus,  D  should  maximize  -J3 .  Equivalently,  when 

is  viewed  as  T  times  the  estimated  cross- 

power  spectrum,  Tdw  _  (f),  the  ML  estimator  selects  as 

xlx2 

the  estimate  of  delay  the  value  of  t  at  which 


u  (f)« — — -t - — -  e- - Af  lR  . 

yly2  -•  xlx2  pXjXgl  Cl-C12(f)J  df'  (3_18a) 


C12<f> 


J2vfr 


where 


Gx'x 

xlx2 


Xx(f)X^(f) 


( 3-18b) 


achieves  a  peak.  That  is,  the  ML  estimator  selects  as 
the  estimate  of  delay  the  value  of  t  at  which  the  GCC 


_  A 

R  *  (t)  -  /  G 
xlx2 


x’ x«  .•  xix2 


(f)Wg(f)ej2irfTdf 


(3-19) 


achieves  a  peak,  where  Wg(f)*H1(f )H£(f)  is  an  appropriately 
selected  weighting  function  (Knapp  and  Carter  (1976)) 

The  ML  estimator  is  equivalent  to  one  proposed  by  Hannan 
and  Thomson  (1973).  The  ML  estimator  can  be  achieved  as 
depicted  in  Figure  3-3  by  shaping  x^t)  with  filter 
Hj(f )  and  x2(t)  with  filter  Hg^)  then  crosscorrelating 
the  filter  outputs  and  observing  what  value  of  delay 
achieves  a  maximum.  The  estimator  can  also  be  achieved 
in  other  forms.  (See  section  C  of  this  Chapter.)  The 
weighting  proposed  by  Hannan  and  Thomson  (1973)  is 

1  C12(f) _  (3-20) 


WML(f)  " 


rV2«>|  (1  .  C12(f)} 


where  (as  required  for  Q, 


-1 


to  exist)  C12(f)  f  1.  Such 


Figure  3-3  Received  Waveforms  Filtered,  Delayed, 
Multiplied,  and  Integrated  for  a 
Variety  of  Delays  until  Peak  Output 
is  Obtained 


weighting  achieves  the  ML  estimator.  When  |G  (f>| 

*1*2 

and  C^f)  are  known,  thin  is  exactly  the  proper 
weighting.  An  Important  consideration  In  estimator 
design  Is  the  available  amount  of  a  priori  knowledge 
of  the  signal  and  noise  statistics.  In  many  problems, 
this  information  is  negligible.  For  example,  in  passive 
detection,  unlike  the  usual  communications  problem, 
the  source  spectrum  is  unknown  or  only  known  approximately. 
Vhep  the  terms  in  (3-20)  are  unknown,  they  can  be 
estimated  via  techniques  of  Carter,  Knapp  and  Nut tall 
(1973a),  which  are  summarized  in  appendix  A  and 
programmed  in  appendix  C.  Substituting  estimated 
weighting  for  true  weighting  is  entirely  a  heuristic 
procedure  whereby  the  ML  estimator  can  approximately 
be  achieved  in  practice.  Such  techniques  have  been 
referred  to  as  approximate  ML  (AML)  techniques  by  Box 
and  Jenkins  (1970)  since  they  are  not,  truly  speaking, 

ML  estimation  techniques. 

Since  the  estimation  of  delay  may,  in  practice, 
be  governed  by  an  AML  rather  than  an  ML  technique,  we 
should  not  expect  that  more  complex  models  will  yield  to 
ML  techniques  without  similar  heuristic  approximation. 
Rather,  the  estimation  of  D  with  moving  sources,  for 
example,  will  also  require  AML  techniques  and  may 
be  even  more  prone  to  varying  interpretations. 
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3B.  Variance  of  Ornoritl  Time  Delay  Estimator 
The  eroescorrelat l»r»  form  of  the  processor  is 
useful  In  ascertaining  the  statistical  characteristics 
of  the  delay  estimate.  For  each  of  several  different 
trials  a  different  estimate  of  delay  might  be  obtained. 
For  example,  when  the  true  delay  is  about  5.0  seconds, 
six  typical  trials  are  sketched  in  Figure  3-4.  One 
actual  example  case  is  given  in  appendix  D.  In 
ascending  orders,  values  of  0  are  4.5,  4.9,  5.0,  5.1, 

5.3  and  5.7.  For  trial  number  5,  depicted  on  the 
Figure  3-4,  an  estimate  4.9  is  obtained.  However, 
there  appear  to  be  many  ambiguous  peaks  in  trial  5; 
indeed  if  the  noise  had  been  slightly  different,  there 
could  have  been  a  different  delay  estimate,  such  as: 

4.1,  5.7,  or  6.5;  such  an  error  would  increase  the 
variation  of  the  time  delay  estimate.  The  derivation  of 

A 

variance  of  D,  which  follows,  does  not  account  for  errors 
due  to  ambiguous  peaks.  Zt  presumes  that  the  estimated 
delay  is  in  the  neighborhood  of  the  correct  delay  and 
not  on  a  secondary  peak. 

A  lower  bound  on  the  variance  for  any  delay 
estimator  (which  is  not  necessarily  attainable)  is  given 
by  the  Cramer-Rao  bound 


E 


-1 _ 

3^1n  p  (x 
3t2 


t»D 


(3-21) 
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Cramer.-Rao  bounds  are  discussed  in  Van  Trees  (1968) 
and  Sage  and  Melsa  (1971).  The  only  part  of  the  log 
pdf  that  depends  on  t,  the  hypothesized  delay,  is 
J3  of  (3-17).  That  is. 


2  2 
E  lnP(5|°*T)}  *  ^5  «4V 


(3-22) 


If  G  „  (f)-  G  „  (f)  e'j2lTfD,  then  since 


X1X2 


X1X2 


6Xlx2(f)]"°V 


(f)  ,  it  follows  that 


E,zlj  \mT f  J2irf(t-D)  — - df  . 

E(-5J3)-T/^e  (1  _  c12(nj 

Hence,  the  minimum  obtainable  variance  for  delay 


(3-23) 


estimation  is  (Carter  and  Knapp  (1976a)) 


Minimum  Var(D)-  T/  (2irf)^ — — -  df 

(1  -  C12  (f )) 

For  the  GCC  processor  with  any  weighting 
Wg(f )«H1(f )HJ(f )  we  will  derive  an  expression  for  the 
local  variation  of  the  delay  estimator  and  show  that 
the  ML  weighting,  (3-20),  indeed  achieves  (3-24).  The 
determination  of  the  variance  of  delay  estimates  closely 
parallels  a  clever  method  of  MacDonald  and  Scbultheiss 
(1969).  Equivalent  to  the  Var  6  «Var  r  I  D  (shown  in 


Figure  3-5)  is  the  left  to  right  variation  of  the  zero 
crossing  of  the  derivative  of  the  GCC  function  output 
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with  respect  to  t  (shown  in  Figure  3-6).  Typical  moan 
output  of  the  derivative  of  the  correlator  output,  7. , 
is  plotted  in  Figure  3-5  together  with  similar  curves 
oz  above  and  below  the  mean.  For  c y  small,  so  that 
curves  are  approximately  linear  between  D-cg  and  D+o^. 

the  magnitude  of  the  expected  value  of  the  slope  of  the 
output  at  the  true  value  of  delay  is  given  by 


TrE  Iz  1 


a 

Ae  R«  x  (t) 
X1X2 


0 

z 

s  •— 

0 

t-D 

T 

(3-25) 


t-D 


where  o  denotes  standard  deviation.  Again  using 

E[°xlx2(f)]  *T  E[*i(f)*2(f)]  "  °x  x  (f>*  11  follows  with 


G«  «  (*)-  °.  *  <f>  e‘J2l,D  that 
xlx2  1  X1X2 


a2 


E 


[*WT)] 


t-D 


«T/  (2irf  ) 


2 


G*  x  (f> 
xl*2 


Wg(f)df .(3-26) 


In  order  to  solve  (3-25)  for  oT=og  it  is  also 
necessary  to  solve  for  o_  in  Figure  3-6.  The  fundamental 
problem  is  to  find  the  variance  of  the  random  variable 
z  given  by 

T 

z  -  /  y1(t)y2(t)dt  .  (3-27a) 

(For  our  particular  problem  we  will  later  assume  that 
y^(t)  is  the  output  of  a  filter  excited  by  x^(t')  and 
y2(t)  is  the  output  of  a  filter  excited  by  x2(t).) 

The  variance  of  z  is  given  by 
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Oz2  -  E(Z2]  -E2  [Z)i 


(3-27b) 


where 


El*]  -B[/t  y^Oy^tMt] 
o 


■  /  E(y1(t)y2(t)]dt 


-  T  R  (0) 
yly2 


(3-27c) 
( 3-27d) 
(3-27e) 


and 


E(*2i  -  /T/T  B(y1(t1)y2(t1)y1(t2)y2(t2)ldt1dt2.  (3-27f) 
o  o 


Evaluation  of  tbo  fourth  moment  In  (3-27f)  can  be  achieved 
under  Gaueelan  aeeumptiona.  In  particular,  If  y^Ct) 
and  y2(t)  are  Jointly  Gaueelan  (and  atatlonary) ,  then 


(3-27g) 


Letting  T-tj-tj  and  ualng  (3-27b)  and  (3-27e),  (3-27g) 

becomee 

-  2 


f(t+t2)f(t2)dTdt2  » 


(3-27h) 


where 


y (t )  -  1  • 

0  ,  elsewhere 


Integrating  (3-27h)  with  respect  to  t2  and  manipulating 

*  5^i<T,v.tT)^.(T,v.<TJ1+d'  <3-27i> 


yields 
_  2  _ 


z 
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For  large  T  (3-271) 


•/  S  T/  lRv.v  <T>Rv„v  <T>+Rv.v  <T>Rv.v <-T**T  • 


l.1  yiyi  y2y2'  yty2'  yxy2 


By  Parseval's  Theorem 


°*2  * 


( 3-27k) 


If  y^(t)  Is  the  output  of  a  filter  H^d)  cascaded  with  a 
differentiator  and  y2(t)  ls  the  output  of  a  filter  H2(f) 


cascaded  with  a  variable  delay,  then 


v  <f>  -  iHdf)!2  (2trf  )2  G  (f) 

y171  i  *ixi 


(3-271) 


Gv  v  <f)  “  lR2<f)l  °X  x  <f> 

y2y2  a  x2x2 


(3-27m) 


Gyly2<f)  "  Hi<f)R2(f>eJ2irfTG 


xlx2 


(f)  • 


( 3-27n ) 


For  t*D  It  follows,  from(3-27k)  -  (3-27n),  since 


Wg( f )"Hj(f )Hj( f ).  that 


cz2  -  T/^  Wg(f  (2-*)2GXixi(nGx2x2(fX1-C12(f),df.  (3-27o) 


Combining  (3-25)  through  (3-27o)  yields 


°D-0t 


{£JV  *  >!<  2*  f )  Gx1x^nGX2x2(  f  )(l-c12(  f  )| } 


(3-28) 


(T )*/  "(2*f)2  G.  _  (f)  W  (f)  df 
-•  *1*2  B 


which  is  valid  for  any  Wg(f).  By  substituting  the 


appropriate  weighting  function  into  (3-28)  the  standard 


deviation  of  time  delay  estimates  from  each  processor 


l»  v  ; 


t  \ 

*Y»V‘ 


I 


_ ■  •  ■  ’  •.•»■*  *  ■  *  i.*  V'vv  i 


can  be  analytically  evaluated. 
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as  source  (not  wavefront)  angle.  Combining  (3-28)  and 
(3-32)  suggests  that  in  order  to  reduce  to  variance  ot 
the  bearing  estimate  the  observation  period  and  the 
sensor  separation  should  be  made  as  largo  as  possible. 
(In  practice,  there  will  undoubtedly  be  limitations  on 
both  sensor  separation  and  observation  time.)  Further, 
since  (3-32)  depends  on  the  effective  array  length 
physically  steered  toward  the  source,  this  suggests  the 
desirability  of  sensor  mobility  to  maximize  the  term 
dsinO. 

It  has  been  shown  that  the  variance  of  the  time 


delay  estimate  In  the  neighborhood  of  the  true  delay, 
for  general  weighting  function  W^(f)  is  given  by 

,  .  ,;|Vf>r<2'f)2V  ',)0Wff  c»<f>] dt 

Var  D  «  »■■■*" . * — — — -  ■  * ^ 3_ 

T[{”<”f>2  »gm  dtj2 

which  for  real  processes  may  also  be  written 

*  *  dvHV1(,>v2<n[i-c“m],2dt .  ,3. 


(3-33a) 


T|/J2irf)-  G^f)  Wg(f)  dfl 


Var  D 


( 3-33b) 


(/  g,  (f) hfjnrdf, 
o  2  I  ^ 

Notice  that  a  scale  factor  change  in  Wg(f)  Hops  not 
change  the  variance  of  the  delay  estimator. 

The  variance  of  the  ML  processor  is 

Var**1*  6  -{2T  /*(2nf )2C12(f )/[l-C  (f)jdf)  1  ,  (3-34) 
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which  is  the  Cramer- Rao  lower  bound  (3-24).  It  should  be 

reemphasized  that  (3-33)  and  (3-34)  evaluate  the  local 

variation  of  the  tine  delay  estimate  and  thus  do  not 

account  for  ambiguous  peaks  which  may  arise  when  the 

averaging  time  is  not  large  enough  for  the  given  signal 

and  noise  characteristics.  Indeed,  when  T  is  not 

sufficiently  large,  local  variation  may  be  a  poor 

indicator  of  system  performance  and  the  envelope  of  the 

ambiguous  peaks  must  be  considered1  (p.  40  of  MacDonald 

and  Schulthelss  (1969)  and  p.  41  of  Hamon  and  Hannan 

(1974)).  Further,  (3-33)  and  (3-34)  predict  system 

performance  when  signal  and  noise  spectral  characteristics 

are  known.  For  sufficiently  large  T,  these  spectra  can 

be  estimated  accurately.  However,  in  general,  (3-33) 

and  (3-34)  must  be  modified  to  account  for  estimation 

errors;  alternatively,  system  performance  can  be 

evaluated  by  computer  simulation.  Empirical  verification 

of  expressions  for  variance  has  not  been  undertaken  by 

simulation,  because  to  do  so  without  special  purpose 

correlator  hardware  would  be  computationally  prohibitive. 

For  example,  for  a  given  G  (f),  G„  (f),  G„  (f), 

•l*l  nlnl  n2n2 

a,  and  averaging  time  T,  an  estimated  GCC  function  can 
be  computed,  from  which  only  one  number  (the  delay 


^These  observations  were  brought  to  the  author's 
attention  by  C.  Stradling  and  R.  Trueblood  of  the  Naval 
Undersea  Center,  San  Diego,  California. 
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estimate)  can  be  extracted.  To  empirically  evaluate 

the  statistics  of  the  delay  estimate  (which  would  be 

valid  only  for  these  particular  signal  and  noise  spectra) 

many  such  trials  would  need  to  be  conducted.  We  have 

conducted  one  such  trial  (with  T  large)  and  verified 

that  useful  delay  estimates  can  be  obtained  by  inserting 

estimates  6_  _  (f)  and  C1q(f)  in  place  of  the  true 
I  I 

values  in  (3-20).  This  might  have  been  expected  since 
the  estimated  optimum  weighting  will  converge  to  the 
true  weighting  as  T-*«.  (The  statistics  of  the  MSC 
estimates  are  given  in  appendix  B.)  In  practice,  T 
may  be  limited  by  the  statlonarlty  properties  of  the 
data,  and  (3-34)  may  be  an  overly  optimistic  prediction 
of  system  performance  when  signal  and  noise  spectra  are 
unknown . 

With  these  qualifications  in  mind,  consider  the 
following  example  of  computing  the  variance  of  the  ML 
time  delay  estimate.  Let 

C12(f)  -<C  ,  fe(0,B) 

fO  ,  otherwise 

Then 


(3-35) 


The  strong  dependence  of  the  estimator  variation  to  the 
coherence  is  illustrated  in  a  plot  of 
Figure  3-7.  Note  since 


I 


versus  C  in 
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jTg  -  C  I  1+C+C2+. . .  ]  .  (3-36) 

that  for  C«l,  (3-36)  is 

»  C  .  (3-37) 

But  for  Ol-A ,  where  A<<1,  then 


C  a 

HC 


1-A  1 

A  A 


1 


1 

^  • 
A 


(3-38) 


An  approximate  comparison  of  00.01  with  00.99  shows 
the  variance  changed  not  by  a  factor  of  100  to  1  but 
10,000  to  1.  The  implication  is  that  weakly  coherent 
signals  do  not  contribute  much  to  reducing  the  variance 
of  the  delay  estimate.  That  Is  not  entirely  so  but  is 
roughly  correct.  For  example,  high  frequency,  low 
coherent  power  may  be  Important.  A  more  complete 
discussion  of  the  variance  of  several  proposed  time 
delay  estimators  is  given  in  Chapter  4.  Prior  to 
Chapter  4,  we  will  discuss  other  realizations  of  the 
ML  delay  estimator. 

3C.  Other  Realizations  of  the  ML  Estimator 

This  section  of  Chapter  3  will  present  four  methods 

for  implementing  the  ML  estimator  for  delay.  One  (and 

only)  of  the  methods,  the  one  considered  to  be  most 

promising,  has  been  programmed. (See  appendix  C.)  The 

program  presumes  that  signal  and  noise  waveforms  are 

real  and  that  their  statistics  are  unknown;  hence  the 

program  uses  appropriate  estimates  in  lieu  of  known  j 

! 

t 
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values,  whan  forming  the  weighting  function. 

The  first  realization  which  cornea  to  mind  la  a 
bank  of  allowable  delays  as  depleted  in  Figure  3-8 . 

Bach  data  waveform  Xj(t)  and  Xgd)  ia  filtered  by  H1(f) 
and  Hg(f ) ,  respectively.  The  output  or  R2(f)  ia 
delayed  for  several  reasonable  values  of  delay  depending 
on  the  resolution  desired,  a  priori  knowledge  and 
processing  cost  allowed.  Each  delayed  output  is  multiplied 
with  the  output  of  H^(f).  After  integration  for  T  seconds, 
the  delay  that  yields  the  maximum  award  is  the  estimate 
of  delay. 

The  second  method  is  to  realize  that  the  bank  of 
delays  in  Figure  3-8  corresponds  to  a  particular  method 
for  computing  the  GCC  function.  Indeed  we  need  not  be 
particular  about  the  details  of  how  the  GCC  function  is 
estimated  so  long  as  it  is  estimated  "accurately." 

The  second  method  uses  the  overlapped  FFT  method 
presented  by  Carter,  Knapp,  and  Nuttall  (1973a)  to 
compute  the  estimated  cross  spectrum  and  MSC.  The 
estimated  cross  spectrum  is  appropriately  weighted  and 
inverse  transformed  via  an  FFT  to  obtain  the  estimated 
GCC  function.  The  delay  where  the  GCC  peaks  is  the 
estimate  of  delay.  One  advantage  to  methods  1  and  2  is 
that  by  computing  the  crosscorrelation  for  a  large 
range  of  delays  the  presence  of  more  than  one  delay 
(acoustic  source)  can  be  observed.  There  are  other 
advantages,  too;  in  the  GCC  method  uncorrelated  cross 
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terms  vanish  and  there  is  no  unknown  residual  bias  to 
account  for  when  establishing  thresholds  (other  than 
the  type  discussed  in  appendix  B) . 


If  we  desire  to  use  a  closed  loop  control  scheme  to 

A 

automatically  adjust  the  delay  estimate  D,  we  can 
Instrument  the  estimator  with  a  derivative  in  one 
channel  much  like  our  discussion  of  the  variance  of  the 
estimator.1  When  we  are  in  the  neighborhood  of  the 
correct  delay,  the  output  in  Figure  3-9  should  be 
approximately  zero.  Any  difference  from  zero  (that  is, 
error)  is  fed  back,  perhaps  smoothed  and  scaled,  and 
used  to  adjust  the  delay  estimate  in  order  to  drive  the 
system  output  to  zero.  For  estimating  more  than  one 
delay  (acoustic  source)  with  this  realization,  more 
than  one  variable  delay  is  required.  It  should  be 
noted  as  pointed  out  by  Kochenburger  (1972)  that 
differentiation  is  a  "noisy"  process  which  should  be 
avoided.  However,  the  filter  H^f)  and  the  integrator 
in  Figure  3-9  may  reduce  the  adverse  effect  of  this 
realization. 

The  final  realization  to  be  discussed  is  the 
method  of  Carter  and  Knapp  (1976a).  In  this  method 
we  re-examine  our  derivation  in  section  3A.  In 


*Thls  Idea  was  brought  to  the  author's  attention 
by  J.  P.  Iannlello  of  the  Naval  Underwater  Systems 
Center,  New  London,  Connecticut. 
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particular,  the  spectral  density  matrix  (3-6),  Tor 
models  like  (3-1)  which  give  rise  to  spectral  densities 
given  by  (3-14),  can  be  expressed  (suppressing  the  f 
dependence)  as 


Q*  •  W*v  > 

where  the  steering  vector 
v*  - 


and, for  uncorrelated  noises. 


(3-39) 


(3-40) 


nlni 


n2n2J  , 


(3-41) 


and  (for  any  given  f)  is  a  scalar.  The  complete 

award  function  to  be  maximised  (3-15)  requires  knowledge 
-1 


of  Qjj 


The  Inverse  of  (3-39)  Is  (Iren  by  Knapp  (I960) 


°.e  S.-^V1 

*  O  e  x  ^  «y  (a 


(3-42) 


1  4  °..v  «n 


For  uncorrelated  noises  Q  "l  does  not  depend  on  D; 

B 

therefore,  the  total  award  is  maximized  by  maximizing 

JD  -  -  |  /  X*H*H*X  df,  (3-43) 

where  the  1x2  vector  filter 


Fvv^T* 


(3-44) 
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By  Parsoval’s  Theorem,  (3-43)  can  be  implemented 


by  filtering  Xj(t)  with  filter  Hj(f)  and  filtering 
XjCt)  with  filter  HgCf).  then  summing,  squaring,  and 

averaging. 

If  we  separate  from  Hg(f)  that  portion  dealing 
with  the  hypothesized  delay  we  can  realize  the  delay 
estimator  as  shown  in  Figure  3-10.  Moreover,  note  that 


m 

jri-  0 

m  * 

1 

m 

nl“l 

.  0  G1 - 

ae‘J2l,fD 

nono 

( 3-45a) 


Further, 

1+0..vVv 


( 3-45b) 


2x1 


1  o  1 

1 

G 

nlnl 

0 

^2lTfD 

n2n2 

m  * 

- 

W 

( 3-46a) 


•l-KSM[l,oe'J2ir,DJ 
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ae 


J2tt  fD 


n2n2 


(3-46b) 
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“lnl 


(3-46c) 


Thus,  the  estimator  can  be  realized  as  shown  in 
Figure  3-11.  For  low  SNR,  that  is,  when 


Vi 


m 


«1  and  a  «1 


“2n2 


m 


l  ♦  q  v’q  -V  a  l 

as  ^n 


(3-47) 


then  the  filter  following  the  sunmation  in  Figure  3-11 
is  approximately  a  unity-gain  zero-phase  all-pass 
network.  Note  in  Figure  3-11  that  the  form  of  the 
filters  at  each  sensor  depends  on  the  signal  and  noise 

JS 

spectrum.  In  particular  the  estimation  of  D  presented 
here  requires  filtering  in  exactly  the  fashion  as  the 
detection  of  a  signal  arrival  presented  by  Knapp  (1966). 
These  low  SNR  filter  forms  are  commonly  referred  to  as 
Sckart  filters  after  early  work  done  in  the  detection 
area  by  Bckart  (1952). 


CHAPTER  4 


COMPARISON  OP  THE  ML  ESTIMATOR  TO  OTHER  PROPOSED 
SUBOPTIMUM  PROCESSORS 

The  objective  of  Chapter  4  la  to  compare  the  ML 
time  delay  estimator  with  several  other  processors 
that  have  been  proposed.  Prom  Chapter  3,  we  know  that 
the  ML  processor  will  have  the  minimum  local  variation. 
Also,  the  previously  derived  expresaions  for  the  local 
variation  of  any  correlation  processor  can  be  used  to 
analytically  compare  other  intuitively  appealing 
correlation  processors.  Additionally,  the  effect  of 
erroneously  identifying  the  signal  spectrum  will  be 
investigated,  since  that  will  cause  the  selection  of  an 
erroneous  weighting  function. 

The  first  section  of  this  chapter  presents  the 
motivation  for  the  use  of  crosscorrelation  processors. 

The  second  section  compares  several  such  processors, 
and  the  third  section  considers  the  interrelationships 
of  these  varloue  proceeeors. 

4A.  Motivation  for  Crosscorrelation  Processors 

For  the  model 

»l<t)  -  s1(t)+n1(t)  (4-la) 

x2(t)  »  as1(t+D)+n2(t)  (4-lb) 

one  common  method  of  estimating  the  time  delay  D  is  to 
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compute  the  crosscorrelation  function 

Rx1x2(T)"BIXl(t)x2(t‘T)  1  *  (4-2) 

where  E  denotes  expectation.  The  argument  t  that 
maximizes  (4-2)  provides  an  estimate  of  delay.  For 
models  of  the  form  of  (4-1).  the  crosscorrelation  of 
x1(t)  and  Xg(t)  Is 


R_  _  (t)-oR  (t-D)+R  _  (t) 
xlx2  *1*1  °ln2 


(4-3) 


The  Fourier  transform  of  (4-3)  gives  the  cross-power 
spectrum 


Gx  (f)-oO  _  (f)e‘J2irfD*G  _  (f) 
X1X2  *1*1  *1*2 


(4-4) 


If  n. (t)  and  n„(t)  are  uncorrelated  (G_  _  (f)-0),  the 
a  •  nln2 

cross-power  spectrum  between  Xj(t)  and  x2(t)  Is  a  scaled 

signal  power  spectrum  times  a  complex  exponential.  Since 

multiplication  In  one  domain  corresponds  to  convolution 

In  the  transformed  domain  (see,  for  example,  Oppenheim 

and  Schafer  (1975)),  it  follows  for  G„  _  (f)»0  that 

nln2 

R,  -  (T)  "aR  ( T )  ©l(  r-D )  .  (4-5) 

X1X2  *1*1 

One  interpretation  of  (4-5)  is  that  the  delta 
function  has  been  spread  or  "smeared"  by  the  Fourier 
transform  of  the  signal  spectrum.  If  s^(t)  is  a  white 
noise  source,  then  its  Fourier  transform  is  a  delta 
function  and  no  spreading  takes  place.  An  Important 
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property  of  autocorrelation  functions  is  that 

R  „  (t)<R_  .  (0).  Equality  will  hold  for  certain 
*l*t  "  al8l 

i  for  periodic  functions  (see,  for  example,  Davenport 
(1970),  pp.  323-320).  However,  for  most  practical 
applications,  equality  does  not  hold  for  t^O,  and  the 
true  crosscorrelation  (4-5)  will  peak  at  D  regardless  of 
whether  or  not  it  is  spread  out.  The  spreading  simply 
acts  to  broaden  the  peak. 

In  fact,  more  generally,  when  x1(t)  and  x2(t) 
have  been  filtered  by  and  H2,  respectively,  then  the 
cross -power  spectrum  between  the  filter  outputs  is 
given  on  p.  399  Davenport  (1970)  as 


Therefore,  the  GCC  between  Xj(t)  and  x2(t)  is 


R  *  (t)-  /. W  ( f )G  .  (f)eJ2lTf  df  , 

xlx2 


*•«**»  _m  g 


(4-6) 


(4-7a) 


where 

Wg(f)«H1(f)Hj(f)  (4-7b) 

denotes  the  general  frequency  weighting.  The  particular 
weighting  selected  is  denoted  by  a  change  in  the  sub¬ 
script  g. 

For  all  of  the  proposed  weightings  which  we  will 


investigate,  W(f)-W*(f)  and  W(f)-W(-f);  that  is,W(f)  is 
real  and  even.  These  properties  are  also  held  by  the 
minimum  variance  ML  weighting. 
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To  distinguish  which  of  the  proposed  general 
weightings  has  been  applied,  we  denote 


°v  y  <f)“G!  x  (f) 
yly2  *lx2 


and  thus 


(4-Ka) 


Gv  y  (*>•  W  (f)IoG 
yly2  8  slsl 


(f)e-J2fffD+G 


nln2 


When  the  noises  are  incoherent,  taking  the  Fourier 
transform  of  (4-8b)  yields 


xlx2 


(T)-R 


oR.  .  <T)  O  4 ( r -D ) 
"l8l 


(4 -8b) 


(4-9) 


where  R  (y).  the  Inverse  Fourier  transform  of  W  (f),  is 

ww  g 

even.  This  being  the  case,  the  true  GCC  will  also  peak 
at  D  regardless  of  the  specific  weighting.  Thus  one 
might  be  puzzled  as  to  why  any  weighting  is  needed. 

Indeed,  the  crosscorrelation  function  alone  is  a  useful 
technique  for  estimating  time  delay. 

Two  practical  reasons  why  prefiltering  is  desirable 


are  evident.  If  the  noise  is  coherent,  for  example,  if 

Gn  n  s  (f)®"J2lrfl>2  ,  (4-10) 

nln2  *2*2 

then 

R*  x  Ct)-R».(t)  9  (oR.  _  (t)  9  4<r-D) 
xl*2  ww  *1*1 

♦  R,  ,  <T>  •  «<r-V]  *  (4-11) 

2  2 

It  is  clear,  from  (4-11),  that  the  convolutions  by 

R_  a  (T)  and  R  „  (t)  will  produce  two  peaks  which  may 
81S1  S2S2 
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bo  spread  into  one  another.  The  convolution  by  R  ( r ) 
can  aid  to  undo  this  smearing.  For  a  single  delay 
broadening  of  the  delay  peak  may  not  be  a  serious 
problem.  However,  when  the  signal  has  multiple  delays, 
the  true  crosscorrelation  is  given  by 

R_  «  <T)-R.  _  (t)®E  a16(r-D1)  .  (4-12) 

*1*2  *1*1  1  1  x 

In  this  case  also,  the  convolution  with  R.  (t)  can 

®lsl 

spread  one  delta  function  into  another,  thereby  making 

it  impossible  to  distinguish  peaks  or  delay  times.  Under 

ideal  conditions  where  Vfp_  _  (f)*G  (f),  W  If)  should 

*1*2  xl*2  * 

be  chosen  to  ensure  large  sharp  peaks  in  R  (t)  rather 

yly2 

than  a  broad  one  (see  Figure  4-1),  since  this  will  ensure 
good  time  delay  resolution. 

There  is  a  second  important  reason  why  prefiltering 

A 

is  desirable.  In  practice,  only  an  estimate  G  (f) 

xl*2 

of  G  (f)  can  be  obtained  from  finite  observations  of 
xl*2 

x1(t)  and  X2(t).  Thus  we  can  never  exactly  obtain  the 

crosscorrelation  from  a  limited  amount  of  time  data. 

Because  of  the  finite  observation  time,  then,  Rv  _  (t) 

xlx2 

can  only  be  estimated.  For  example,  for  real  ergodlc 
processes  an  estimate  of  the  crosscorrelation  is  given 
on  p.  327  of  Papoulls  (1965),  as: 

Rx  x  (T)«  /  Tx1(t)x2(t-T)dt  ,  (4-13) 

12  T 
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where  T  represents  the  observation  Interval.  For  limited 
duration  data  records ,  the  accuracy  of  the  delay  estimate, 
0,  can  be  improved  by  prefiltering  x^Ct)  and  x2(t) 
prior  to  the  Integration  in  (4-13).  In  practice  we  can 
eosqrate  (4-13)  by  weighting  the  estimated  cross  spectrum 
and  computing  an  inverse  Fourier  transform  to  obtain  an 
estimated  GCC  as  follows: 

fi<‘>  (t )-/  W  (f)G  (f)ej2irftdf  .  (4-14) 

xl*2  -•  *  X1  2 

V  (f)  now  serves  to  Improve  the  estimate  of  Rv  „  (r) 

9 

used  to  estimate  time  delay. 

In  practice,  depending  on  the  particular  form  of 
Vg(f)  and  the  a  priori  information,  it  may  also  be 
necessary  to  estimate  fg(f).  For  example,  when  the  role 
of  the  prefilters  is  to  accentuate  the  signal  passed  to 
the  correlator  at  those  frequencies  at  which  the  SNR 
is  highest,  then  Wg(f)  can  be  expected  to  be  a  function 
of  signal  and  noise  spectra  which  must  either  be  known 
a  priori  or  estimated. 

Hence,  we  see  that  the  true  crosscorrelation 
function,  for  the  model  (4-1),  is  sufficient  to 
determine  the  correct  time  delay;  but  for  practical 
(finite  data)  considerations  it  is  desirable  to  prefilter 
x^(t.)  and  x2(t)  prior  to  crosscorrelation.  Indeed,  the 
problem  of  selecting  Wg(f)  to  optimize  certain  performance 
criteria  is  not  new  and  has  been  studied  by  several 
investigators.  (See,  for  example,  Akaike  and  Yamanouchi 
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(1963),  Bangs  (1971),  and  Hannan  and  Thomson  (1971).) 
Our  Intuitive  discussion  of  sharply  peaked 


estimators  may  suggest  certain  types  of  weighting. 
However,  sharp  peaks  are  more  sensitive  to  errors 
Introduced  by  finite  observation  time,  particularly  in 
cases  of  low  SNR.  Thus,  as  with  other  spectral 
estimation  problems,  the  choice  of  Wg(t)  is  a  compromise 
between  good  resolution  and  stability.  In  the  subsequent 
section  we  compare  several  promising  weighting  functions 
proposed  previously  in  the  literature. 

4B.  Comparison  of  Proposed  Processors 
The  preceding  discussion  provides  background  for 
the  role  that  Wg(t)  is  to  play.  Now  the  six  versions 
of  the  generalized  crosscorrelation  function  listed  in 
Table  4-1  will  be  examined  individually.  In  the  process 
of  comparing  the  processors  in  Table  4-1,  there  will  be 
a  tendency  to  want  to  look  at  some  simple  cases,  for 
example,  equal  white  noises  and  strong  (or  weak)  white 
noise  signals.  In  this  regard,  it  can  be  shown  for  the 
case  where  G„  „  ( f ) -G„  „  (f)«G  (f)  is  equal  to  a 

nl“l  n2n2  nn 


constant  times  G 


■  _  (f)  (whether  or  not  the  signal  is 

•l*l 


white)  that  five  of  the  processors  in  Table  4-1  provide 
for  the  identical  frequency  weighting,  except  for  a 
constant.  (The  crosscorrelation  processor  (W(f)-l.Vf) 
is  a  delta  function  smeared  out  by  the  Fourier  transform 
of  the  signal  (noise)  power  spectrum. )  In  these  cases. 


TB  5335 


Table  4-1.  Proposed  Processors 


Processor  Name 


Weight 

KO-H^nH^f) 


1.  Roth  Inpulse  Response 


i/Gx  _  (f) 
xlxl 


2.  Smoothed  Coherence 
Transform  (SCOT) 


1/ 


V°xixi 


(*)G  (f) 

X2X2 


3.  Phase  Transform  (PHAT) 


1/0  x  (f) 
X1X2 


4.  Crosscorrelation 


5.  Eckart 


s  <*>/&„  n  (f)Gn  (f) 
181  nlnl  n2n2 


6.  Maximum  Likelihood 
(ML) 


cl2(f) 
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the  .delay  estimate  from  each  of  these  five  processors 
will  have  the  same  variance.  Hence,  a  complete  comparison 
can  only  be  made  when  detailed  signal  and  noise  character¬ 
istics  are  provided.  Such  information  is  largely 
dependent  on  the  particular  application  and  a  detailed 
comparison  is  therefore  beyond  the  intent  of  this  work. 

For  underwater  acoustic  applications,  characteristics 
of  the  radiated  and  self  noise  of  ships,  submarines,  and 
torpedoes  and  the  noise  background  of  the  sea  are  given 
by  Urlck  (1967).  For  more  fundamental  signal  and  noise 
characteristics,  it  is  useful  to  provide  a  brief  example 
of  using  (3-33)  and  (3-34).  Suppose  the  example 
corresponds  to  (4-1)  where  a»l;  G>s(f)-1,  Vfe(-B.B) 

otherwise  G  ( f )-0;  G„  ( f )*G  (f)»l,Vf.  it  follows 

ss  n2n2 

from  (2-1)  and  (2-2)  that 


C12<f> 


°ss<*> 


to.-m+o-  (f>nG(f)+Gn  _  (f )) 

88  88  n<)D« 


.(4-15) 


*1“1 


2  2 


Hence, 


cl2(f) 


10.25  ,  V  f  (-B.B) 

*0  ,  otherwise  . 

Other  values  are  given  in  Table  4-2. 

4B1.  Roth  Processor 


The  weighting  proposed  by  Roth  (1971) 

xT^  ' 

xi*i 


5 


(4-16) 


where  the  subscript  R  is  to  distinguish  the  choice  of 
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Wg(f),  yields 


;<r> 


•  °»  x  (f> 

*ii2  #J2irfTdf  > 


i  x  <T>"/  -g— ■  m 

*12  -•  °x1x1lIJ 


1 4-17 ) 


Squat Ion  (4-17)  estimates  the  impulse  response  of  the 
optimum  linear  (Vlener-Hopf )  filter t 


H_(f  )■ 


*1*2 


(f) 


*1*1 
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(4-18) 


which  "best"  approximates  the  mapping  of  x2(t)  to  x1(t) 
(see,  for  example.  Van  Trees  (1968),  Carter  and  Knapp 
(1973)  and  the  discussion  of  Theorem  2-3  ).  If  n1(t)^0, 
as  is  generally  the  case  for  (4-1),  then 


°x  x  (,)"°e  s  (f)*°n  n  <f>  * 
*1*1  *1*1  Bl“l 

and  ideally 


(4-19) 


(R) 

l*l*2 


oG.  .  (f) 


m  g  g  '  ' 

(t)-«(t-D)  •  /  - ™#J2wfrdf  .(4-20) 

-•  s1s1v 

■  m 


Therefore,  except  when  Gn  (f)  equals  any  constant 

nlnl 


(including  zero)  times  Gm  (f),  the 

*1*1 


delta  function  will 


again  be  spread  out.  The  Roth  processor  has  the 
desirable  effect  of  suppressing  those  frequency  regions 


*As  discussed  earlier,  W(f)  may  have  to  be  estimated 
for  this  processor  and  those  which  follow,  because  of  a 
lack  of  a  priori  information.  In  this  c*se,  (4-16)  may 
require  that  G_  _  (f)  be  replaced  with  G„  _  (f). 

*1*1  *1*1 
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where  G_  „  (f)  is  large  and  6  _  (f)  ie  therefore 

°iai  xixa 

more  likely  to  be  In  error. 

From  (3-33), 


-  ^2-  (1-C)f2df 

Var(fi).  -S - 1  1 - 


(4-21) 


In  the  example  of  Table  4-2  this  becomes 
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®  a  3  ®  o 

fa  |  df»/n  faldf 
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8»2  T 


>f24df]: 

L°  J 


(4-22a) 


m3,  4m3  4m3 

B  ♦  j*  -g8 


I**™6 


(4-22b) 


when  B-H  (4-22b)  agrees  with  (3-35)  as  expected;  but 
if  H  la  large  In  comparison  with  B,  the  variance  of  the 
Roth  processor  will  be  large  In  comparison  to  the 
Crame'r-Rao  bound  (3-24). 

4B2.  Smoothed  Coherence  Transform 

A 

Errors  in  G_  (f)  may  be  due  to  frequency  bands 
xlx2 

where  G_  (f)  is  large,  as  well  as  bands  where 
n2n2 

G  (f)  is  large.  One  is  therefore  uncertain  whether 
nlni 


a 
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to  form  WR(f)-l/G„  „  (f)  or  WB(f)-l/G„  v  (f);  hence 


X1X1 


X2X2 


S3 


the  smoothed  coherence  transform  (SCOT)  proposed  by1 
Carter,  Nuttall,  and  Cable  (1973)  yields 


W,(f)  -  1/ 


(f)0,  -  (f) 
X2X2 


This  weighting  gives  the  SCOT 


(4-23) 


-(•>  12lTfr 

R*  X  (T)  mf  Y.  x  (f)eJ2irrrdf  , 
xlx2  -  xlx2 


(4-24) 


where  the  coherence  estimate' 


xlx2 


(f)A 


X1X2 


Cf) 


fvi 


rmrrcrr 


X2X2 


Por  h(t)mi/——  and  tyf)-!/ 
“  xlxl 


X2X2 


T7Y 


(4-25) 


,  the 


SCOT  can  be  interpreted  as  prewhitening  filters  followed 

by  a  crosscorrelation.  When  G  (f)*G^  _  (f),  the 

xlxl  X2X2 

SCOT  is  equivalent  to  the  Roth  processor.  If  n^(t)^0 
and  n2(t)ftO,  the  SCOT  exhibits  the  same  spreading  as 
the  Roth  processor. 


lTbe  SCOT  was  originally  proposed  by  G.C, Carter, 
A.H.  Nuttall,  and  P.G. Cable  in  1972  and  successfully 
applied  to  actual  data  by  G.C. Carter  and  P.G. Cable  in 
1972  and  Braidy  (1973)  for  part  of  his  Ph.D.  work. 

2  A  more  standard  coherence  estimate  is  formed 
when  the  autospectra  must  also  be  estimated,  as  is 
usually  the  case.  (See  Carter,  Knapp  and  Nuttall  (1973a).) 
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From  (3-33) 


Var(D)- 


/-f  (l-C(f)Jdf 


.  o 


(4-26) 


Note  ms  C(f)-»1,  the  numerator  becomes  small  and  the 
denominator  becomes  large.  For  our  example,  since 

(f)«G  (f)  the  SCOT  has  the  same  variance  as 

xl*l  x2*2 
the  Roth  processor. 

4B3.  Phase  Transform 

To  eliminate  the  spreading  evident  above,  the 
phase  transform  (PHAT)  uses  the  weighting1 


Wn(f) 
p  !G 


xl*2 


(f) 


which  yields 
.(P) 


-  Gx  x  <f) 

ft'*"  r  12  J2*fx 

*x,x„(T)  1  |G_  _  (f)!*  df 


12 


X1X2 


(4-27) 


(4-28) 


For  the  model  (4-1)  with  uncorrelated  noise  (that  is, 


nln2 


(f)-0), 


Gx  x  (f) 
xlx2 


■oG_  -(f). 
®lsl 


(4-29) 


*The  PHAT  was  originally  suggested  by  G.C. Carter, 
A.H.  Nuttall  and  P.G.  Cable  in  1972. 
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Ideally,  when  G  (f)-G  -(f). 

*1*2  xlx2 


G_  -  (f) 

-  e^(0.eJ2efD 

UXjXj' 1 ' 


has  unit  magnitude  and 

RiPi  (T)-«(t-D)  . 
X1X2 


The  PHAT  was  developed  purely  as  an  ad  hoc 
technique.  Notice  that,  for  models  of  the  form  of 
(4-1)  with  uncorrelated  noises,  the  PHAT  (4-28), 
Ideally,  does  not  suffer  the  spreading  that  other 
processors  do. 

From  (3-33), 

<PL  /If2J_(l-C)  df 


▼ir(6> 


(4-30) 


(4-31) 


8*^  [/  f2dfj2 

As  0*1,  *0 ,  so  the  processor  will  behave  well 

flthat  is,  low  variance).  However,  as  expected,  as  0*0 
the  variance  grows  without  bound.  For  the  example  in 
Table  4-2,  assuming  the  weighting  is  zero  for  f>H  , 


(4-32) 


(P)~ 

Var(D)* 


j 

8w2T 

s - - 

H  2 
/  fzdf 

•  o 

2 

df 


(4-33) 


Except  when  H-B,  this  processor  will  suffer  a  complete 
breakdown  as  C  tends  to  zero.  When  H*B,  we  obtain  the 
same  variance  as  the  Roth  and  SCOT  processors  for  then 
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(as  indicated  earlier)  G  <^)“Gw  (f)-G„  (f)  and 

nlnl  n2n2  S1  1 

all  processors  behave  equally  well.  For  models  of  the 
form  of  (4-1),  the  poor  behavior  of  the  PHAT  suggests 
that  V(f)  should  not  be  Inversely  proportional  to 
signal  power.  The  crosscorrelator  is  one  method  of 
avoiding  the  application  of  weight  Inverse  to  signal 
characteristics.  Two  other  processors  in  Table  4-1 
also  assign  weights  or  filtering  proportionate  to  SNR: 
the  Eckart  filter  (Eckart  (1952))  and  the  ML  estimator 
or  processor  of  Hannan  and  Thomson  (1973).  We  now 
examine  these  three  processors  in  depth. 

4B4.  Crosscorrelation 
The  variance  of  the  delay  estimate  from  the 
crosscorrelatlon  processor  is 


XC  *  /  f^  xl*i  X2X2^”^<^ 

Var(D)-  — - 

8w^T 


For  the  example  case  in  Table  4-2,  (4-34)  yields 


XC  A 
Var(D) 


*  2  3  H  q 

/  f  -4-|df+/  t* ldf 

o  ’  B 

'  2_r  ®  2  f 

8irTV  1  ldf 


b3.  H3  B3 

®  3  ~  5 


"5  nC 

8'  T  § 


(4-34) 


(4-35a) 


(4-35b) 
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For  H*B,  (4-35b)  agrees  with  earlier  results.  The 
crosscorrelftor  actually  performs  bettor  than  either 
the  SCOT  or  the  Roth  processor  for  the  particular 
example  case  in  Table  4-2.  In  general,  one  can  expect 
to  find  cases  for  particular  spectra  where  the  cross* 
correlator  performs  worse  than  the  SCOT  or  Roth  processors. 

4B5.  Eckart  Filter 

The  Eckart  filter  derives  its  name  from  work 
in  this  area  done  by  Eckart  (1952).  Derivations  in 
Knapp  (1966),  and  Nuttall  and  Hyde  (1969),  are  outlined 
here  briefly  for  completeness.  The  Eckart  filter 
maximizes  the  deflection  criterion,  namely,  the  ratio 
of  the  change  In  mean  correlator  output  due  to  signal 
present  to  the  standard  deviation  of  correlator  output 
due  to  noise  alone.  For  long  averaging  time  T,  the 
deflection  has  been  shown  to  be 


f  H,(f) 
_•»  * 


H2(f) 


(4-36) 


G  _  (f)GB  (f)df 
nlDl  n2°2 


where  L  is  a  constant  proportional  to  T,  and  G_  (f) 

sls2 

is  the  cross-power  spectrum  between  s1(t)  and  s2(t). 

For  the  model  (4-1)  G_  _  (f)-aG.  ( f  )exp(  j2irfD) . 

*1*2  *1*1 

Application  of  Schwartz's  inequality  indicates  that 

H1(f)Hj(f)-WE(f)e+J2lTfD  (4-37) 
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maximizes  df  where 


Vf)  - 


a(5  g  (f) 

al8l _ 

G_  _  (f)G  ( 
nlnl  B2B2 


(4-38) 


notice  that  the  weighting  (4-38),  referred  to 

as  the  lekart  filter,  poaaeeaee  some  of  the  qualities 

of  the  SCOT.  In  particular,  it  acts  to  suppress 

frequency  bands  of  high  noise,  as  does  the  SCOT.  •  Also 

note  that  the  Eckart  filter  unlike  the  PRAT  attaches 

zero  weight  to  bands  where  G.  _  (f)-0.  Tn  practice, 

®lsl 

the  Eckart  filter  requires  knowledge  or  estimation  of 
the  signal  and  noise  spectra.  For  (4-1),  when  a»l  this 
can  be  accomplished  by  letting 


(4-39) 


The  variance  of  the  time  delay  estimate  using  Eckart 
filtering  is 


Var(D) 


„  — 5= - jr— G  G  (l-C)df 

/  f2  G„2_  G„  \  X1X1  X2X2 

o  nini  °2b2 _ 


(4-40) 


2,f'2kx  G”  _ 

o  xlx2  G  „  G 

!  nlnl  n2n; 


For  the  example  case  in  Table  4-2 , 

Var(D)-  V2<!  df 

2  '  ®  2  ^  ” 
8 *zT/’_  f^df 


(4 -4 la) 
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8.2__3 


Ub » 
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that  is,  for  this  example  the  Eckart  filter  achieve? 
the  Cramer-Rao  lower  bound  (3-24).  In  general  this 
will  not  always  occur.  In  the  next  section  we  see 
that  (4-41b)  is  the  variance  achieved  by  the  ML 
processor.  This  might  be  expected  since  both  the 
Eckart  and  ML  processors  pass  nothing  in  the  signal 
frequency  band  (B,H)  and  both  have  constant  weighting 
over  the  band  (0,B).  Actually,  the  ML  estimator  is 
closely  related  to  the  Eckart  filter,  as  will  be  seen 
tn  section  4C  of  this  chapter. 

4B6.  Maximum  Likelihood  Processor 
As  shown  In  Chapter  3  the  ML  processor  always 
has  minimum  variance.  For  the  Table  4-2  example,  the 
correct  weighting  from  (3-20)  Is  W(f)»l/3  for  fe(-B.B) 
and  zero  otherwise.  Now  from  (3-34) 


-[§  -f  • 


ML, 


Var  (D) 


(4-42) 


Thus,  the  minimum  variance  depends  on  a  time  bandwidth 

,2 


product,  TB  multiplied  by  the  bandwidth  squared,  B  . 
Suppose  an  error  had'  been  made  identifying  the  frequency 
band  of  the  signal.  Then  if  we  presumed  that  the 
weighting  was  l(f)«l/3  for,  say,  fe(-aB,aB) ,  in  lieu  oi 
f  (-B,B),  we  would  obtain  from  (3-33) 
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when  a>l 
Var(D)  • 


L2+0  |  t*2b3 


(4-43) 


which  reduces  to  (4-42)  when  a*l.  For  example.  In  this 
eaww,  a  10  pwreent  error  (that  is,  a-1.1)  leads  to  more 
than  aa  11  percent  Increase  in  variance.  If  a<l  then 


(3-33)  becomes 


Var(D) 


'■?[* 


Ttt2B3 


(4-44) 


which  agrees  with  (4-42)  when  a*l.  Thus  a  10  percent 
error  (a«O.0)  leads  to  an  increase  in  variances  of 
37  percent.  Thus  our  example  suggests  it  may  be  more 
desirable  to  let  in  extra  noise  than  to  omit  signal 
power.  Finally,  if  our  error  led  to  processing  the  band 
fc(aB,B)  and  fc(-B,-aB),  we  would  obtain 


Var(D) 


i  r 

1-a3 


|  nV 


(4-45) 


which  agrees  with  (4-42)  when  a«0. 


The  ratio  of  variances  (4-45)  to  (4-42)  for 


a<<l  is 


x,  i+.3 


(4-46) 


If  we  again  err  by  10  percent  (l.e.,  a-0.1),  then  (4-46) 
yields  1.001  or  little  change  in  the  variance.  (This 
error  Is  at  lower  frequencies  In  the  signal  band  and 
as  (3-33)  suggests,  proper  weighting  is  most  critical 
at  higher  frequencies.)  Thus,  for  this  example, 


I\V' 


Lv;- 

^1; 
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depending  on  how  we  make  a  10  percent  error  In  frequency 
band  selection,  we  can  have  anywhere  from  0.1  percent 
to  a  37.0  percent  Increase  in  variance  of  the  time 

delay  estimate. 

4C.  Interpretation  of  Relationship  Between 
Correlation  Processors 

For  the  case  where  a«l 
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alal 


which  agrees  with  equation  (28)  of  MacDonald  and 

Schultheiss  (1969)  if  in  (4-47b)  GB  (f)-G_  n  (*) 

n^n^  n2n2 

For  low  SNR, 


0  (f)  G  (f) 

*1B1  *1*1 
*— = — »-xt  <<1  and  »  j'mv  «1  , 


alal 


it  follows  that 


n2n2 


Vf); 


o,  .  (*> 

8i8i 


-  W£(f)  ; 


(4-48) 


Notice  that  agreement  requires  «•! 


Y-.v 


K‘*v 
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that  is,  for  a*l  sad  low  SNR,  the  ML  processor  is 
Identical  to  the  Eckart  filter.  Similarly,  for  low 

SNR, 


l,(f) 


alal 


nysrrrry 


n2a2 


(4-49) 


Therefore,  if  o«l, 
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(4-50a) 


Furthermore,  for  G„  „  ( f )"G>>  (f)«G  (f), 
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Gs  s  (f) 
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wp(f). 


(4 -50b) 


Thus,  under  low  SNR  approximations  with  a«l,  both  the 
Eckart  and  ML  prefilters  can  be  interpreted  either  as 
SCOT  prewhitening  filters  with  additional  SNR  weighting 
or  PHAT  prewhitening  filters  with  additional  SNR  squared 
weighting. 

We  can  rewrite  (4-47)  as 
1 


WML<f>- 


J  0B  B  ( 
"  “lal 


n2n2 


is 


V  ~nlni~n2n2 


+A" jfVT 


(4-51) 
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for  uniformly  high  SNR, 
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that  la,  giving  the  weighting  characteristics  similar 
to  the  SCOT  at  low  SNR.  Note  that,  like  the  ML  processor, 
the  PHAT  computes  a  type  of  transformation  on 


a 


(f) 


2 


Sx  x  ITS 

xlx2 


exp  J$(f) 


(4-53) 


However,  the  ML  processor,  like  the  SCOT,  weights  the 
phase  according  to  the  strength  of  the  coherence.  From 
p.  379  of  Jenkins  and  Watts  (1968),  comparing  (B-22) 
with  equation  (9.2.19)  and  (9.2.20)  of  Jenkins  and  Watts 
(1968)  the  variance  of  the  phase  estimates  is  given  by 


Var  4(f)*  , 


(4-54) 


where  N  is  the  number  of  independent  FFTs  used  to 
estimate  phase.  Notice  as  C*l,  Var  $  -*-0 .  Thus, 


(ML)  i  ** 

R*  x  <T>"  f  5 

xlx2  N  -• 


Var  <Kf) 


e^"fTdt 


(4-55) 


Comparison  of  (4-55)  with  (4-53)  reveals  that  the  ML 
estimator  is  the  PHAT  inversely  weighted  according  to 
the  variability  of  the  phase  estimates. 

The  ML  processor  has  been  compared  with  five 
other  candidate  processors  to  demonstrate  the  inter¬ 
relation  of  all  six  estimation  techniques.  The 
derivation  of  the  ML  delay  estimator  (in  Chapter  3), 
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together  with  its  relation  to  various  ad  hoc  techniques 
of  intuitive  appeal  (in  this  chapter),  suggests  the 
practical  significance  of  ML  processing  for  estimation 
of  time  delay  and,  thence,  bearing.  The  remainder  of 
this  thesis  deals  with  extensions  of  the  ML  processor 
to  more  complex  models  and  a  discussion  of  the  results 
and  suggestions  for  future  work. 
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CHAPTER  5 

MORE  COMPLEX  MODELS 

Chapter  3  answered,  for  a  simple  model,  the 
fundamental  question  of  this  thesis:  Vhat  is  the 
"best"  method  of  estimating  time  delay"  Chapter  4 
compared  this  method  with  several  other  candidate 
processors.  Chapter  5  considers  three  conceptually 
straightforward  extensions  of  the  problem  considered 
in  Chapter  3:  (1)  multiple  source  models,  (2)  moving 

source  models,  and  (3)  multiple  sensor  models.  The 
"solution"  to  these  problems  is  more  difficult  than 
the  problem  of  estimating  a  single  time  delay  for  a 
stationary  source.  For  example,  in  the  multiple  source 
and  multiple  sensor  models,  there  is  more  than  one 
delay  to  be  estimated.  Indeed,  if  we  treated  multiple 
sources  and  multiple  sensors  together,  we  would  need  to 
estimate  a  parameter  vector  for  each  source,  corres¬ 
ponding  to  the  (relative)  delays  between  that  source 
and  each  sensor;  thus,  a  (nonsquare)  matrix  of  delays 
(comprised  of  a  parameter  vector  for  each  source) 
would  need  to  be  estimated.  Finally,  it  is  necessary, 
in  effect,  to  estimate  the  motion  of  each  source  so  as 
to  be  able  to  Doppler  correct  the  received  signals 
prior  to  crosscorrelation.  Failure  to  apply  some  sort 
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of  Doppler . correction  will  cause  the  received  signals 
to  be  essentially  uncorrelated  even  if  a  common  (but 
frequency  shifted)  signal  is  present. 

Both  notationally  and  analytically,  the  methods 
applied  to  estimate  the  unknown  parameters  become  more 
complex  than  the  methods  in  Chapter  3.  Yet  even  in 
Chapter  3  where  a  "solution"  for  the  ML  estimate  of 
time  delay  was  possible,  we  noted  that,  in  practice, 
it  would  be  necessary  to  resort  to  an  AML  estimation 
technique;  for  more  complex  models  there  is  no  reason 
to  expect  that  the  solution  will  become  simpler;  indeed, 
in  this  chapter  (especially  with  regard  to  moving 
sources),  we  appeal  more  to  approximate  and  ad  hoc 
techniques  based  on  the  ideas  of  Chapter  3  than  to 
rigorous  methodologies.  The  reasons  for  this  approach 
are  apparent  in  section  B  and  have  to  do  with  the 
nonstationaritles  Introduced  by  the  source  motion. 

8A.  Multiple  Source  Models 
The  simplest  multiple  source  model  is  a  two 
source  case  where  receiving  sensors  are  physically 
steered  at  one  source  and  the  second  source  acts  as  an 
Interference.  Such  a  model  is  depicted  in  Figure  5-1 
(Carter  and  Knapp  (1975)).  Mathematically, 

xx(t)  -  s1(t)+s2(t)+n1(t) 


(5-la) 


(!) 
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(The  effect  of  an  interfering  source  on  detection  is 


considered  by  Schulthelss  (1968).)  The  problem  is  to 


estimate  the  parameter  D.  In  effect  a^(t)  accounts  for 


correlated  noise  insofar  as  estimation  of  D  Is  concerned. 


.  When  s^(t)  and  Sg(t)  are  stationary  uncorrelated 

signals  with  power  spectra  0.  .  (f)  and  G_  _  (f)  and 

8181  a2s2 

when  n^t)  and  »j(t)  are  stationary  uncorrelated  noises 


with  the  same  power  spectrum  G_.(f),  It  has  been  shown 

DO 


by  Carter  and  Knapp  (1975)  that 


Y_  _  (f)-  1+ 2— = 
xlx2  “sjSj 


G,2B2(f)  _-.12irfD 


Gs  s  <f> 

slsl 


8181 


S2S2 


(5-2) 


In  the  special  case  when  G„(f)«0  and  G  „  (f)«G_  _  ( f ; 

cn  8181  S2S2 


Yx  x  (f)-  j(  1 ♦e“^  2ff  *D ) »e“^  *  * Dcosw f D 
1  2 


(5-3) 


Cx  x  (f)-cos2trfD  ■  ^(l+cos2irfD) . 
1  2 


(5-4) 


Because  of  the  sinusoidal  oscillation  between  0  and  1 


of  _  (f),  the  Fourier  transform  of  (5-3)  will  exhibit 
xlx2 


a  peak  at  the  value  of  time  delay.  This  suggests  the 


usefulness  of  computing  the  Fourier  transform  of  the 


coherence  or  SCOT  (Carter,  Nuttall  and  Cable  (1973)) 


A  more  general,  multiple  source,  two  sensor  model  is 


x.(t)  -  l  s.(t)+n,(t) 


(5-5a) 


x,(t)  •  I  a1si(t+Di)+n2(t)  . 


(5-5b) 


1 


m 


sew 


.•V 


v,v 


I**.’. 


The  Halt  on  the  sum  depends  on  the  number  of  sources. 
Since  each  source  will  be  presumed  to  be  Independent  of 
the  others,  the  sources  will  be  autuslly  uncorrelsted. 

For  the  general  two  source  case  depicted  as  a  multi-input, 
aultfroutput  systea  In  Figure  5-2,  It  follows  that 


Xj(t)  »  B^tHSjCtHnjd) 

(5-6a) 

x2(t)  ■  OjSjd+DjJ^OgSjtt+DgJ+njtt) 

and  therefore 

(5-6b) 

°x  x  (,)  *  °«  s  (f)+Gs  s  (,)+Gn  n  (f> 

*1*1  *1*1  *2*2  nl“l 

(5-7a) 

G_  x  <*>  “  °12°«  .  C*)^«22g«  s  (t)HSn  n  <f> 

*2*2  1  *1*1  3  *2*2  *2*2 

(5-7b) 

and 

°-  x  (t)  •  *,0  (t)*~j2vfDl 

*1*2  1  *1*1 

*  “aV.  <*>s“J2wfDa 

3  *2*2 

+  °n  n  <f>  • 

*1*2 

(5-7c) 

However,  we  can  accoaaodate  coherent  noise  through  the 
inclusion  of  additional  sources  so  that  without  loss  of 
generality  6  _  (f)"0  for  all  frequencies.  Froa  the 

two-source  model  with  incoherent  noise,  we  generalize  that 


and 


G*  x  (,)  "  °n  n  <f>*IG.  .  <f> 
*1*1  *1*1  1  *1*1 

0-  _  <*)  •  <L  _  (f)ela*0_  .  (f) 
*2*2  *2*2  1  1  *1*1 


0,  _  (f)  -  ro.G  (f)e*’jairn>i  * 
*1*2  1  1  *1*1 


<5-Sa) 

(S-Sb) 

( 5-Sc ) 
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Zb  the  ML  estimation  procedure  earlier  the  determinant 
of  Qg  could  be  ignored  alnce  it  did  not  depend  on  D. 
Nov.  however,  for  the  two-source  model,  we  eee 
(euppreeaing  f)  that 


0.  .  *K»_  _  _  .  a.G  e"J2w,Dl+a  G  e 

•i*i  Va  Bi“i  1  Vi  2  *a*a 

0  e^^^G,  .  e^2irfDa,  G  , 

1  BjOj  2  *2*2  X2X2 


-jairfD, 


k  5- 9a ) 


doee  depend  on  (D^Dg).  For  example,  even  when 
Gnini-Gn2na-°nn'  “l^a-1  and  Vj*6*,*;6..' 

|  Q  |  -  ( 30M+<*nn  )  a-oM2  ( 2w  fDl+*“'3  2*  ,Da  )  (  e* j 2t  fDi*e*J  2x  ,Da ) 

(5 -9b) 

| Q  |  “4GMa+aG>,ann+Gnna'Gee2  [2+*'J  2*  *  ( Da‘Dl  2w  f(D2~Dl^ 

(5-9c) 


In  general,  |Q|  depends  on  the  parameter  vector 
(Oj.Og).  Thus,  we  must  be  concerned  by  the  |Q|  as  well 
as  the  exponent  in  (3-9),  for  the  multiple  source  model. 
Specifically,  we  want  to  maximize  the  sum  of  both  (3-17) 
and  the  logc|Q  j  term.  The  latter  is  given  by 


N  -* 

h  -  E  log  |Q| 

k— N  * 


(5-10) 


but 


|Q|  ’ 


0  0 

xixi  . xixa 


o  *  G 
X1X2  X2X2 


■  G  G  fl-C  )  . 
X1X1  X2X2  X1X2 


(5-11) 
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Thus, 

lo*elQ|-»  -  <t-c«1*a)'  •  (!-,2) 

But  iog^O^  _  G„  _  doss  not  depsnd  on  (D..D,,...)  so  that 
•  X2X2  A  * 

the  critical  parameters  in  the  |Q|  term  ars  approximately 
given  by 

-  *T  /  log  fl-C*  _  (f)]df .  (5-13) 

In  practice,  x^  and  x2  will  have  finite  bandwidth; 
therefore  the  limits  of  the  integral  (5-13)  will  also  be 
finite.  It  is  noteworthy  that  the  second  term  is  related 
to  the  definition  by  Shannon  (1949)  for  the  amount  of 
information  about  x2(t)  contained  in  x^t).  More 
specifically,  Gelfand  and  Yaglom  (1959)  and  Nettheim  (1966) 
have  shown  that  the  amount  of  information  about  x  contained 
in  y  (or  vice  versa)  is  given  by1 

Xxy"  ’  I  /loge(l-Cxy(f)]  df,  (5-14) 

where  the  limits  of  Integration  are  over  the  nonzero 

range  of  the  integrand.  Hence,  for  C  (f)*0,  there 

xy 

9 

is  no  Information  (in  the  linear  sense)'  contained  in  one 

*Th*se  results  can  be  combined  with  (2-79)  for 
models  like  Figure  2-5  to  show  that  Ixy  is  the  integral 
of  the  logarithm  of  1  plus  received  signal  to  noise  ratio. 

2 

See  Carter  and  Knapp  (1975)  or  Chapter  2  for  a 
discussion  of  nonlinear  relations  which  can  yield 
CXy(f)"0  and  yet  y(t)  can  be  entirely  due  to  x(t).  as  for 
example,  when  y(t)«xz(t). 
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time  series  with  regard  to  the  other.  Alternatively,  if 


C  (f)-l,  for  some  particular  fn,  then  there  is  an 
infinite  amount  of  information  about  x(t)  knowing  y(t) 
at  the  particular  freouency  fp.  More  generally,  for 
nonzero  C  (f)<l,  the  amount  of  information  depends  on 
the  bandwidth  (limits  of  integration  in  (5-14))  and  the 
MSC  in  that  band. 

Thus,  following  (3-15)  and  (5-10)  through  (5-14). 
we  see  that  it  is  desired  to  maximize 


J-T 


*  °x1x2Gx1x2 
»-,♦*/  g 1 2  1  - 


_a  u_  _  o_  _  _  5 

*  —  *2*2  *1*2 


df 


(5-15) 


For  the  two  source  model. 


J-T 


-  a  o,0  •♦J*'**! 

*1*2  1  Vl _ df  ♦ 


12 

— SS 


IQI 


2/ 


-  0  o,G  .+J2vfD2 
xlx2  2  *2*2 _ 

IQI 


df 


(5-16) 


or  for  two-sensor,  multiple  source  model  we  maximize 
-  0  <f  Uo.G  (I)e*J!”Dl 

♦a/  -1  V» 


j-T 


X1X2  - 


df 


(5-17) 


Iqu>I 

Thus,  the  Important  regions  of  the  estimated  cross 
spectrum  for  determining  are  these  frequency  bands 

where  G  .(f)  1*  lsrge.  However,  even  when  the  signal 

■i"i 

spectrum  is  strong,  if  the  intersource  interference  is 

such  that  the  intersensor  coherence  C,  v  (f)  is  low,  the 

xl*  2 
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weight  attached  to  the  estimated  cross  spectrum  Is 
degraded,  as  shown  above. 

While  we  can  estimate  auto  spectra  and  coherence 
between  sensors,  sore  sophisticated  methods  must  be 
applied  In  order  to  estimate  the  source  signal  spectrum. 

The  matheawtlcs  shows  how  to  process  for  known  signal 
spectrum.  In  the  communications  problem,  signal  spectrum 
will  generally  be  known,  although  a,  which  more  generally 
could  be  a  function  of  frequency,  will  probably  not  be 
known.  In  other  problems,  methods  involving  classification 
and  data  bank  retrieval  need  to  be  studied.  In  the 
absence  of  a  priori  knowledge,  we  might  assume  that 
every  frequency  band  where  the  coherence  was  high  was 
a  different  source.  Tracking  (that  Is,  estimating 
bearing  continuously)  for  each  frequency  band  then 
becomes  a  classification  problem  where  the  number  of 
sources  Is  ascertained  by  noting  the  number  of  clustered 
sources.  The  fewer  the  sources  for  a  given  total  source 
power  the  easier  tracking  will  be.  However,  repeated 
clustering  analysis  will  be  desirable  to  ascertain 
whether  two  or  more  sources  are  being  classified  as  one. 

In  "real  world"  problems,  there  may  well  be  more 
than  one  source;  hence ,  the  application  of  Chapter  3 
results  must  include  the  concepts  of  multiple  sources. 

There  are  other  concerns,  too,  in  the  practical 
application  of  our  Chapter  3  results.  The  next 
generalization  which  we  will  discuss  is  the  moving  source 


120 


problem . 


SB.  Moving  Source  Models 
The  model  we  shall  consider  Is  a  simplified 
one  characterized  by  the  observed  waveforms  (Carter 
and  Knapp  (1976b)) 

x1(t)-s(t)-*-n1(t)  (5-18uj 

y2(t)-os(8t+D)+n2(t)  ,  (5-18b) 


where  s(t),  n1(t)  and  n2(t)  are  zero  mean  jointly 
stationary  Gaussian  random  processes  which  are  mutually 
uncorrelated.  The  problem  addressed  here  is  ML 
estimation  of  the  time  compression  and  delay  parameters 
8  and  D,  respectively;  the  problem  is  related  to  the 
Doppler  shift  work  by  Van  Trees  (1971).  The  character¬ 
istics  of  the  signal  and  noise  are  such  that  x^(t)  is  a 
member  function  of  a  zero  mean  stationary  Gaussian 
random  process.  Further,  despite  the  attenuation,  delay 
and  time  compression,  y2(t)  is  also  stationary  and 
Gaussian.  That  is,  both  autocorrelation  functions  given 
by 


R_  »  <T>  "  K  «  (t)+Rss(t) 
*1X1  °lnl  ■■ 


and 


Ry2y2<tl*t2>-Rnan2(t2“tl>*aR”<B<t2“tl)) 


( 5-19a) 


(5-19b) 


depend  only  on  the  time  difference  tj-t^. 

However,  the  crosscorrelation  for  model  (5-18) 
depends  on  8  as  follows : 


(5-1 9c) 


RXiya(ti,ta)-oBl0(ti)«(6t2+D)]-aR8S<t1-Bt2-D) 
Ryax1(tl,t2)"oBl*<Btl’fD)a(t2)I“aR88<#tl+®~t2)  • 


As  required, 


Rx1y2(tl’t2) 


Ry2x1(t2'tl) 


(5-20) 


Notice  the  crosscorrelation  depends  on  8  as  well  at 
and  t2,  and  not  simply  the  difference  between  t^  -and  tj. 
Hence  the  processes  Xj(t)  and  y2(t)  are  not  jointly 
second  order  stationary,  but  depend  on  the  absolute  time 
origin.  Thus,  the  introduction  of  time  compression  2  in 
our  model  thereby  complicates  the  theory  through  the 
imposition  of  a  second  order  nonstatlonarlty.  [For  a 
variety  of  practical  reasons,  we  desire  to  operate  on 
y2(t)  in  order  to  ensure  complete  statlonarlty.] 

An  ad  hoc  technique  for  estimating  D  is  to 
operate  on  y2(t)  to  remove  (or  adjust)  the  time  scale 
change  0.  The  result,  referred  to  as  x2(t),  may  then 
be  used  with  x^(t)  in  the  usual  ML  estimator  of  Chapter 
3.  This  Indeed  turns  out  to  be  the  ML  estimator  for  this 
problem  (as  is  subsequently  shown).  A  major  problem, 
of  course,  is  that  6  as  well  as  delay  D  must  be  estimated 
to  undo  the  time  scaling  Introduced  by  motion  of  the 
source.  Suppose  for  example,  Is  one  estimate  (or 
hypothesis)  of  6  (like  t  was  a  hypothesized  delay  in 
Chapter  3)  and  let 

*2(t)  A  F2(t/Ba) 


( 5-21a) 
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»  as(0t/0a+D)+n2(t/0a)  . 

Now  th«  crosscorrelation  of  Xj(t)  with  x2(t)  is  Riven  by 


vr>-21b) 


( 5-22a) 


"  B*„<v£vD>  • 


( 5-22b' 


Thus,  for  0a"0,  we  see  that  x1(t)  and  x2(t)  are  second 


order  Jointly  stationary,  for  then  R  (t.,t0)  depends 

xlx2  1  z 


only  on  the  time  difference  T-tj^-tg.  For  Ba*6,  it  is 
possible  to  compute  a  single  Fourier  transformation  on 


t  to  achieve 


G_  _  (f)«/  *  _  (T)e“J2irfTdT 

xlx2  --  xlx2 


( 5-23a ) 


“°Gss(f)*  J2irfD  • 


( 5-23b) 


Similar  results  can  be  obtained  using  the  concept  of 


locally  stationary  random  processes  (Silverman  (1957)). 


However,  in  general,  when  0ysa,  a  two-dimensional 


Fourier  transformation  must  be  performed.  For  convenience 


let  0*0/0a  (where  we  ultimately  hope  to  make  0"1  by 
proper  choice  of  6  then  it  follows  that 


l[xl(k)Xj(i)J  -  -%/Tdt1/Tdt2R#8(t1-0t2-D)  .  (5-24a ) 


o  o 


#-Ju>0(ktj-lt2) 


-  In  the  following  it  may  be  assumed  that  0  «1 
and  0»0  ;  that  is,  that  y2(t)  has  not  been  preprocgssed . 
Results  can  then  be  applied  with  0*1  (rather  than  8*1); 
for  many  problems  0*1. 


l*  e_  *’•  # 
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Equation  (5-24)  of fora  a  more  rigoroua  interpretation  of 
(5-23).  For  large  T  and  8  near  unity,  it  followe  from 
(5-24f )  (ainee  the  discrepancy  between  the  sins  functions 
is  minor)  that 

0  ^(f)  -  T  ECx1(k)xJ(l)1 

.  aOM(kwA)e“JkwAD  ,  1-kB 

0  .  lj»kS  . 


(5-25a) 


(5-25b) 


Also, 


T  E[X1(k)Xi(l)l- 


and 


0n1n1<k“A>+G..<kV'1-k 
0  .  l^k 


( 5-25c) 


T  S[X3(k)xJ(l)]- 


ku. 


Note  in  (5-25d)  G 


n2n2 


8aGn2n2<8akwA>+f..^T)’1"k 

0  ,lf*‘ 

is  evaluated  at  B_ku>.  not  kw, . 


(5-25d) 


a  A  “wv  ““A 

Similarly,  it  can  be  shown  for  6"1  and  large  T,  that 

Jkw.D 


E(Xa(k)Xj(l)]  - 


°Oas(k«A>*  A  1-k/B 


(5-26) 


0  lj»k/B  . 

fe  now  proceed  as  in  Chapter  3,  Section  A.  In  particular, 
we  desire  to  maximize  a  total  award  function  JA,  as 
depicted  in  Figure  5-3,  through  the  adjustment  of 
hypothesized  compression  Bft  and  .hypothesized  delay  t ; 
when  JA  is  maximized,  the  ML  estimates  3  and  6  depicted 
in  Figure  5-3  are  achieved. 

It  is  important  to  the  discussion  that  follows  to 
note  that  if  Ba  is  incorrectly  selected  such  that  B  is 
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much  different  from  unity,  the  processes  x^(t)  and  x2(t) 
are  second  order  jointly  nonstationary  and  the  estimators 
are  not  ML  estimators.  However,  once  we  have  begun  t<> 
estimate  delay  and  compression  correctly,  the  processor 
is  an  ML  estimator;  that  is,  in  the  sequential  estimation 
problem  where  several  observation  intervals  are  available, 
then  ML  or  at  least  AML  estimation  is  possible  in  the  last 
intervals.  Before  proceeding,  we  also  note  that  if 
B^l  any  crosscorrelation  (coherence)  terms  in  the  award 
J A  will  be  zero.  More  specifically,  if  B  is  much 
different  from  unity,  then  time  delay  cannot  be  estimated 
without  some  type  of  Doppler  or  time  compression 
preprocessing.  The  Importance  of  this  statement  is  that 
Chapter  3  cannot  be  applied  to  estimate  bearing  to  moving 
sources  which  are  nearfleld  (relative  to  the  sensor 
separation)  unless  time  compression  preprocessing  is  done. 
Denote  the  Fourier  coefficients  of  x1(t)  and  x2(t)  as  in 
Chapter  3.  The  2N+1  vectors  X(k)alx1(k) ,x2CBh)l ' ,k«  -N, 
-N+1,...,N  for  B«l,  are  uncorrelated  Gaussian  (hence, 
Independent)  random  variables.  More  explicitly,  because 
of  the  Independence,  the  pdf  for 

X5{X1(-N)^2(-N6)}‘  ,{X1(-N+1),X2[(-N+1)B]  )*,  .  .  .  f  Xi ( N ) . 

X^NB)}* 

given  the  true  values  of  attenuation  a,  delay  D  and  time 
compression  B  (actually  we  also  are  given  6a',  hence  are 
"given"  B"B/Ba  )  is  the  product  of  the  individual 
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v 


•V 


densities . 


SJ 


( 5-27a) 


Specifically  when  8a»l  and  8*1  the  pdf  of  ^  is 
N  1 

p(2EI«.e.D)  -  n  (hkexp(-  yJk)3 
k“-N 


where 

Jk  -  TlxJCkJxJCk)]^”1  (kuA)  xx(k) 

x2(k) 

and  « 

•[.(2a)|Qx(kwA)|i]  , 


(5-27b) 


(5-27c) 


and  Qx(f)  Is  the  power  spectral  density  matrix  between 
the  random  processes  x1(t)  and  x2(t). 

For  ML  estimation,  it  is  desired  to  simultaneously 
choose  as  6  and  0  those  values  which  maximize  the  pdf 
evaluated  for  hypothesized  compression  0R  and  hypothesized 
delay  t.  Equivalently,  0  and  5  are  selected  to  maximize 
any  monotonlcally  increasing  transformation  of  the  pdf. 
Hence,  0  and  D  are  selected  to  maximize  the  log  pdf, 
namely, 

N  N 

JA  •  In  p(X|a,0,D)  Llnhk-  \  (5-28) 

k»-N  k«-N 


While  the  derivation  provides  sufficient  information  on 
estimating  the  parameters  0  and  D,  it  is  valuable  to 
interpret  (5-28)  in  order  to  understand  both  its  meaning 
and  its  Implementation.  The  award  to  be  maximized  (5-28) 
can  be  written  (assuming  large  T)  as  three  terms 
substituting  (5-14)  and  (3-15)  ' 
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JA*IX  *  -/  5 
*  *1*3  -•* 


*1*1 


*1X1 


*  5 


*2*2 


XjXq 


*1*2  C12 


1  it*!  - , 

PiJ]  —1*1*2 1  [1-C12I 


♦J2itfx 


d f  .  (5-29) 

Unlike  Chapter  3,  C12  depend*  on  0.  Equation  (5-29) 
le  difficult  to  interpret;  it  ie  comprised  of  three  terms. 
For  ML  estimation  (versus  AML  estimation),  only  the  last 
two  terms  of  (5-29)  depend  on  the  data.  However,  the 
parameters  0  and  D  appear  in  all  three  terms  of  (5-29); 
hence,  all  three  terms  must  be  considered.  The  first 
term  of  (5-29)  is  small  with  respect  to  the  second  term 
(because,  from  (5-14),  the  information  has  a  logarithm 
in  it);  also,  the  first  term  of  (5-29)  is  email  with 
respect  to  the  third  term.  Hence,  we  might  expect  that 
the  first  term  can  be  Ignored.  However,  under  some 
common  degenerate  cases  ( epee 1 f leal ly,  tHD  and  T  very 
large)  the  sum  of  the  second  and  third  terms  does  not 
depend  on  the  parameters  0  and  D.  For  example,  for  r-D  and 


very  large  T,  6, 


•G  ,  i-1 , 2  and 
il  11 


t  x  -1°x  X  I*'32’1” 
*1*2  *1*2 


and  the  sum  of  the  last  two  terms  of  (5-29)  becomes 
•  1-C 

-/  ■  |j^df ,  which  is  a  constant.  This  situation  is 


perplexing  since  the  remaining  term  in  (5-29)  (namely, 
the  information  (5-14))  does  not  depend  on  the  data,  but 
only  on  the  (assumed  known)  statistics  of  the  data.  It 
is  Interesting  that  when  this  is  the  case  and  when  we 
apply  AML  techniques  (that  is,  we  use  estimated  data 
statistics  for  assumed  known  statistics),  the  data  do 
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ipp«ftr  Id  the  expression  for  the  information. 

Finally,  «e  notice  if  ae  a  euboptiaum  technique, 
we  were  to  take  the  first  or  last  term  in  (5-29)  and 
simply  maximise  it,  that  to  do  so  would  require  adjusting 
the  parameter  estimates  so  as  to  attempt  to  increase  the 
coherence  across  the  entire  frequency  band;  the  second 
term  of  (5-29)  does  just  the  opposite.  Notice  when  the 
time  compression  is  estimated  incorrectly,  C12-°  and 
only  the  information  Ij^  (°r  ^2^  is  needed  to  estimate 
compression.  Having  estimated  compression  correctly, 
only  the  last  term  of  (5-29)  is  needed  to  estimate  delay. 
This  suggests  a  suboptimum  ad  hoc  technique  for  estimating 
0  and  D,  namely,  maximize  the  Information  to  estimate 

A 

0  then  use  that  0  to  estimate  D  with  the  award  function 
of  Chapter  3.  In  practice,  this  suboptimum  technique 
should  compare  favorably  with  maximizing  (5-29),  since 
there  are  a  number  of  assumptions  and  approximations 
leading  to  the  award  function  (5-29);  most  notably, 

(5-29)  presumes  0*1  so  that  joint  second  order  stationarlty 
holds.  When  this  is  not  the  case,  maximizing  (5-29) 
becomes  simply  an  advisable  but  ad  hoc  estimation 
procedure . 

There  are  some  degenerate  cases  of  the  model 

(5-18)  that  are  easier  to  work  with  analytically  (namely, 

D  known  and  equal  to  zero,  n2(t)"0  and  a«l).  Such  models 

have  rather  predictable  results  (namely,  the  cross- 

correlation  terma  are  important  except  as  G  ( f )-«  , 

n,  n. 
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that  is,  a s  one  of  the  observation  channels  becomes 
noise  dominated;  in  the  later  case,  the  hypothesized 
time  compression  attempts  to  align  the  estimated  auto 
spectrum  with  the  (known)  signal  spectrum).  Thus,  the 
degenerate  cases  do  not  add  insight  into  the  fundamental 
issue  of  stationarlty.  Ve  are  thus  led  to  state  that 
maximizing  (5-29)  (or  first  (5-14)  and  then  the  last 
term  of  (5-29))  by  choice  of  §  and  6  (respectively)  is 
merely  an  intuitively  appealing  ad  hoc  technique. 

5C.  Multiple  Sensor  Models 

The  problem  we  address  here  is  estimation  of  a 
parameter  vector  D  from  a  set  of  sensors  with  received 
voltages 

x4(t)  -  ais(t+Di)-fn1(t)  1*1,2. . .  .  (5-30) 

Although  the  notation  for  Di  is  the  same  as  Section  A, 
this  model  should  not  be  confused  with  a  multiple 
source  model,  since  this  model  is  only  one  source  but 
many  sensors.  To  extend  the  problem  to  many  moving 
sources  received  at  many  sensors  requires  that 

xi(t)  ’  ti  •i.k,[»i,kt*Di,k]l+ni(t>  (5-31> 

In  the  model  (5-30),  we  assume  (without  loss  of 
generality)  that  a^*l  and  Dj*0;  thus 

xx(t)  -  s(t)+n1(t)  (5-32) 

x2(t)'  •  a2s(t*D2)*n2(t) 

•  i 

•  • 

xM(t)  -  aMs(t+D||)-«-n1|(t) 
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and  we  desire  to  eatlsute  the  M-l  dimension  relative 


delay  vector  (Dg-D^,  Dg-D^, . . . . 

The  general  solution  to  this  problem  Is  simply 
an  extension  of  the  alternate  realisation  In  Chapter  3, 
Section  SC.  Xn  particular,  the  steering  vector  le  now 


For  uncorrelated  noises 

q,  -  11111-0,^^1  . 


The  lxM  vector  filter  Is  given  by 

-1 

H  -  CH^Hj 


%  6mu 

Hjj]  -  «  "  ^ 1 

’ly*1 


(3-33) 

(S-34) 


(5-33) 


Hence,  the  generalisation  Is  realized  by  extending 
Figure  3-10  to  If  prefilters  with  one  at  each  sensor 
location  as  shown  in  Figure  5-4.  A  more  explicit 
realization  Is  given  In  Figure  3-3,  which  is  the  extension 
of  Figure  3-11. 


ft) 


Figure  5-4  Multiple  Sensor  Estimation  of  Delay  Vector 


CHAPTER  6 


DISCUSSION 

6A.  Applications  and  Summary 
The  purpose  of  this  section  is  to  briefly 
sunmarlze  and  discuss  the  applications  of  this  work. 

Most  of  the  applications  are  Intimately  tied  to  the 
theoretical  results  already  presented  which  are  summarized 
in  the  subsequent  paragraphs.  The  primary  purpose  of  this 
section  is  to  highlight  applications  of  the  theory  with 
a  minimum  of  reliance  on  mathematical  notation.  There 
are  three  main  applications  for  the  theory  of  time  delay 
estimation  discussed  in  the  following  three  subsections. 
First,  it  is  a  useful  vehicle  for  parameter  identification. 
Second,  we  can  use  it  to  obtain  bearing  estimates. 

Finally,  under  certain  conditions  we  can  estimate  source 
position.  These  applications  rely  on  the  theory 
developed  in  the  preceding  text,  which  is  summarized  in 
the  following  two  paragraphs. 

This  dissertation  has  investigated  methodologies 
for  passive  estimation  of  the  bearing  to  a  slowly 
moving  acoustically  radiating  sourcs.  As  demonstrated, 
the  mathematics  for  the  solution  to  this  problem  is 
analogous  to  estimating  the  time  delay  between  two 
time  series.  Because  the  estimation  of  time  delay  is 


closely  related  to  the  coherence  between  two  time 
series  an  extensive  Investigation  of  coherence  has  been 
presented.  New  results  on  using  coherence  to  provide 
information  about  linear  and  nonlinear  systems  have 
been  presented  and  proved. 

The  ML  estimate  of  time  delay  (under  Jointly 
stationary  Gaussian  assumptions)  has  been  derived. 

The  explicit  dependence  of  the  time  delay  estimate  or 
coherence  is  evident  in  the  estimator  realization  ir 
which  the  two  time  series  are  prefiltered  (to  accentual 
frequency  bands  according  to  the  strength  of  the 
coherence)  and  subsequently  crosscorrelated.  The 
hypothesized  delay  at  which  the  GCC  function  peaks  Is  *-he 
time  delay  estimate.  From  the  GCC  realization  the 
variance  of  the  time  delay  estimate  has  been  obtained. 

By  use  of  a  different  interpretation  of  the  MI.  estimator 
derivation,  other  realizations  have  been  obtained.  The 
GCC  realization  with  ML  weighting  is  compared  to  several 
other  proposed  weightings.  The  estimation  formulation 
has  been  extended  to  three  important  generalizations: 
multiple  sources,  moving  source  and  multiple  sensors. 
Nonstatlonarities  introduced  as  a  result  of  source  motion 
are  studied.  These  results  can  now  be  applied  to  three 
problem  areas  of  interest. 

6A1.  Parameter  Identification 

In  the  system  identification  problem  we  are  given 
a  system  with  unknown  description.  We  design  a  probe 


to  excite  the  system  end  eneure  that  the  probe  la 
sufficiently  rich  in  frequency  content  (G  (f)>0, 
fc(-B,B) ) .  Then  we  simultaneously  observe  (perhaps 
record)  the  probe  (input)  and  response  (output)  of 
the  system.  The  objective  of  these  observations  is 
to  characterise  the  system.  In  Chapter  2  it  has  been 
shown  that  there  exists  a  linear  filter  which  will 
characterize  the  system  if  the  MSC  is  unity  at  all 
frequencies.  (Appendix  C  provides  a  computer  program 
for  estimating  MSC  between  two  waveforms  (input  and 
output).)  When  the  MSC  is  not  unity,  the  characteriza¬ 
tion  is  considerably  more  complex,  Ve  have  looked  at 
certain  no  memory  nonlinearities  and  shown  how  they  can 
be  characterized  by  orthogonal  polynomial  expansions. 

The  main  thrust  of  the  dissertation,  however, 
has  been  to  estimate  one  parameter  (delay)  when  the 
system  is  linear,  but  the  observations  are  corrupted 
by  noise.  Proper  estimation  of  Just  this  one  parameter 
requires  knowledge  of  the  magnitude  transfer  function 
a  (or  more  generally  |a(f)|),  And  finally  knowledge 
of  the  noise  spectral  densities.  When  this  a  priori 
knowledge  is  not  available,  we  have  proposed  eetimatlng 
the  unknown  quantities  and  substituting  them  in  place 
of  the  known  quantities.  There  is  no  rigorous 
derivation  to  support  this  procedure  other  than  to  note 
that  as  the  observation  time  becomes  large  the  eetlmated 
quantities  converge  to  the  true  ones.  Thus,  the 
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methodologies  applied  to  the  time  delay  estimations  can 
be  expected  to  be  even  more  complex  if,  for  example, 
the  filter  output  were  XjCtJ-a^t+Dji+ajSCt+DgHn^t) . 
More  generally,  if  x2(t)  was  the  output  of  an  FIR 
digital  filter  of  unknown  ord'er  then  the  problem  of 
estimating  the  order,  the  delays  and  the  attenuations 
(see  Hannan  and  Thomson  (1971),  Hannan  and  Robinson 
(1973)  and  Carter  and  Knapp  (1976a))  is  a  more  general 
problem  than  the  one  addressed  here.  However,  to  solve 
the  bearing  estimation  problem  motivating  this  research, 
the  added  generality  is  not  required.  Thus,  the  problem 
considered  here  is  only  a  subset  of  the  parameter 
identification  problem.  Further,  note  that  the  solution 
to  the  time  delay  estimation  problem  does  not  Involve 
the  Fourier  transform  of  the  optimum  Wiener-Hopf  filter 
(Roth  processor),  which  maps  x1(t)  closest  to  x2(t); 
that  is,  the  technique  does  not  look  at  the  peaks  or 
midpoint  of  the  impulse  response  of  the  filter  that 
in  the  MUSE  sense  filters  x^(t)  to  obtain  an  optimum 
x2(t).  Vlth  these  comments  in  mind,  we  have  generalized 
our  model  to  an  Important  class  of  nonstatlonarltles 
in  order  to  estimate  bearing. 

6A2.  Rearing  Estimation 
The  bearing  estimate  follows  directly  from  the 
delay  estimate  according  to  the  simple  arccos  trans¬ 
formation  (3-2).  The  range  does  not  need  to  be  too 
great  relative  to  the  sensor  separation  in  order  for  the 
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angle  that  the  hyperbola  asymptote  makes  with  the 
baseline  to  accurately  represent  the  source  beaming. 

For  stationary  sources  or  closely  spaced  sensors,  the 
relative  Doppler  (or  more  generally,  the  time 
compression)  can  be  ignored.  However,  to  apply 
these  techniques  to  widely  separated  sensors  and 
moving  sources,  it  is  necessary  to  process  the  data 
in  order  to  perform  Doppler  correction  (that  is,  a 
time  scale  correction  or  time  scale  expansion).  To 
ignore  this  processing  would  result  in  an  apparent 
uncorrelated  behavior  between  the  two  received  waveforms. 
One  contribution  of  this  work  has  been  to  specify  an 
ML  estimate  of  time  compression.  However,  because  of 
the  nonstationarity  of  the  processes  involved,  the 
results  tend  to  be  more  heuristic  and  more  difficult 


to  interpret  (and  implement)  than  those  for  the  time 
delay  estimation  problem.  In  fact,  the  implementation 
is  hindered  by  practical  computational  issues  of  achieving 
the  time  compression.  Nevertheless,  in  the  future  as 
computational  methods  allow  for  broadband  time 
compression,  the  methods  hypothesized  here  could  actually 
be  tested  in  practical  environments.  This  should  not 
be  Interpreted  to  mean  that  time  compression  cannot 
currently  be  accomplished.  Exact  time  compression  can 
be  achieved,  «s  for  example,  with  variable  speed  tape 
recorders  or  with  exact  DFT's.  Approximate  time 
compression  can  also  be  achieved  through  complex  inter- 
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polation.  of  FFT  points  or  nearest  FFT  bln  approaches. 

In  practice,  all  of  these  techniques  are  expensive 
to  implement;  hence,  any  production  application  of  the 
theory  will  benefit  from  advances  in  methodologies 
and  mechanizations  for  achieving  time  compression. 

Having  techniques  for  estimating  the  bearing  to  moving 
acoustic  sources,  we  can  extend  the  applications  of  our 
theory  to  estimating  range. 

6A3.  Passive  Ranging 

In  the  two  sensor  models,  we  are  able  to  estimate 
delay  from  which  we  can  estimate  bearing.  In  the 
multiple  sensor  situation  more  information  is  available. 
Indeed,  with  three  sensors  we  can  also  estimate  source 
location.  For  example,  in  Figure  6-1  three  equispaced 
colllnear  sensors  are  depicted.  As  indicated  in 
section  5C,  the  estimate  of  r®<iuires  simultaneously 

processing  data  from  all  three  sensors  (one  suboptimum 
processor  would  be  to  estimate  each  bearing  from 
generalized  crosscorrelations  between  only  two  sensors). 
When  the  sensor-pair  midpoints  are  separated  by  distance 
d  (meters),  the  range  (meters)  to  the  source  is  given  by 

dsln09 

*  ‘  '  <e-1> 

An  estimated  range  is  obtained  by  inserting  estimated 
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Figure  6-1  Three  Colllnear  Sensore,  Single  Source 
Passive  Ranging  Geometry 
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bearings  la  (0-1 ).*  The  asymptotes  depicted  In 
Figure  0-1  are  upper  bounds  (biased  estimates  of 
hyperbolic  LOP's);  hence,  the  actual  source  location 
will  be  slightly  "below"  the  Intersection  depicted. 

For  ft»d,  the  bias  will  not  be  a  practical  concern. 

For  more  complicated  sensor  geometries  (see 
Figure  0-2),  the  bearings  01  and  02  are  used  to  obtain 
effective  bearings  6j*  and  02*.  When  the  sensor 
geometry  is  known,  the  effective  bearings  are  easily 
obtained  by  the  addition  of  a  correction  term  to  the 
observed  bearing.  Similarly,  the  effective  separation 
d#  is  simply  the  shortest  distance  between  the  midpoints 
of  the  sensor  pairs  (1,2)  and  (2,3).  The  range  estimate 
is  then  obtained  by  substituting  effective  measurements 
into  (0-1).  When  four  or  more  sensors  are  used  to 
estimate  three  or  more  LOP's,  source  position  may  be 
ambiguously  specified,  as  shown  by  points  A,  B,  C  in 
Figure  0-3.  In  such  a  case,  it  is  reasonable  to  presume 
that  the  source  is  the  least  squares  distance  from 
existing  LOP's;  although  it  is  possible  for  two  or 
three  sources  to  be  present. 


^The  estimated  position  (range  and  bearing,  in 
polar  coordinates)  obtained  by  substituting  ML 
estimates  of  the  bearings  into  (6-1)  is  not  necessarily 
the  ML  estimate  of  position. 
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6B.  Susa eat ions  for  future  Work 

This  section  suggests  four  areas  for  future 
work.  In  a  ssnss ,  it  provides  an  insight  into  ehat 
we  still  do  not  know  about  the  problem  at  hand.  Or 
stated  differently,  having  solved  the  problem  we  net 
out  to  solve,  we  now  understand  bow  to  pose  new  problems 
which  we  have  uncovered.  First,  in  the  parameter 
identification  area  there  appear  to  be  several  fruitful 
research  questions:  How  to  identify  parameters  for 
(1)  general  (or  particular)  nonlinear  systems,  (2) 
multi-input,  multioutput  linear  systems,  (3)  general 
linear  systems,  and  finally  (4)  "real  world"  socio- 
economic  systems.  The  complexity  of  estimating  time 
delay  suggests  that  the  solution  to  these  problems  will 
be  more  complex. 

The  second  area  is  verification  of  the  theory 
by  simulation.  We  have  already  conducted  one  costly 
computer  experiment  (Appendix  D)  which  substantiates 
our  belief  that  insertion  of  estimated  spectra  for 
true  spectra  enhances  the  estimation  of  time  delay. 
However,  without  running  many  such  experiments,  we  have 
no  statistical  argument  to  substantiate  the  theory. 
Because  the  cost  of  running  this  analysis  is  prohibitive 
on  a  large  scale,  digital  computer,  special  purpose 
FIT  hardware  should  be  used  to  empirically  validate  the 
theory.  The  cost  of  such  a  system  will  be  significant. 


The  third  area  of  investigation  is  an  extension 
of  the  theory  to  sequential  estimation.  In  practice, 
our  observation  interval  will  not  be  just  T  seconds; 
rather  there  will  be  several  consecutive  periods  of 
T  seconds.  Knowing  that  the  source  is  constrained  in 
its  rate  of  speed,  we  should  be  able  to  rule  out 
certain  ambiguous  estimates  of  delay  (bearing).  More 
generally,  we  could  model  the  ship's  track  and  use 
Kalman  filter  techniques  to  extrapolate  best  projected 
position  (bearing)  based  on  the  filter  outputs. 

Finally,  the  theory  presumes  a  great  deal  about 
(1)  ocean  acting  as  a  linear  time  Invariant  filter  over 
the  observation  period  T,  (2)  the  characteristics  of  the 
noise,  and  (3)  the  source  motion.  Thus,  the  true 
engineering  test  is  to  make  controlled  measurements  with 
actual  acoustic  sources  in  the  ocean  in  order  to  test 
the  hypothesis.  Based  on  what  we  currently  know,  there 
is  every  reason  to  believe  such  an  endeavor  will  be 
successful . 
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TECHNIQUES  FOB  SPECTRAL  ESTIMATION 

The  basic  objective  of  this  appendix  is  to 
briefly  describe  two  (similar)  techniques  used  to 
estimate  the  elements  of  the  power  spectral  density 
matrix.  The  estimates  obtained  are  then  used  to  form 
an  AML  estimate  of  time  delay.  The  two  techniques  are 
the  overlapped  FIT  technique  (discussed  by  Carter, 

Knapp,  and  Nuttall  (1973a))  and  the  Chlrp-Z  transform 
(CZT)  technique  (discussed  by  Carter  and  Knapp  (1975)). 

The  methods  discussed  are  sometimes  referred  to  as 
direct  methods  (as  opposed  to  indirect  correlation 
methods)  and  have  been  discussed  in  part  by  Knapp  (1966), 
Welch  (1967),  Bingham,  Godfrey  and  Tukey  (1967),  Benlgnus 
(1969a),  Nuttall  (1971),  Williams  (1971),  and  Rabiner  and 
Radsr  (1972). 

Both  methods  begin  with  two  (one  from  each  process) 
digital  waveforms  (or  with  analog  waveforms  that  have 
been  lowpass  filtered  and  digitised).  Briefly,  there 
are  four  steps  la  the  estimation  procedure:  First,  each 
time  series,  is  sepmnted  into  N  segments,  each  having 
P-data  points.  Second,  each  segment  is  multiplied  by 
a  smooth  weighting  function.  Third,  the  Z  transform  of 
the  weighted  P- point  eequence  is  evaluated  on  the  unit 
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circle  in  the  Z-plane.  Finally,  the  Fourier  e<*ef  ficients 
LhuH  obtained  are  used  to  estimate  the  elements  of  the 
power  spectral  deselty  matrix  by  averaging  "raw"  power 
spectral  estimates  over  all  tbs  M  segments.  The  two 
methods  of  spectral  estimation  differ  la  how  the  Z  transform 
is  evaluated.  One  method  uses  the  FFT ;  the  other  uses  the 
Partitioned  and  Modified  CZT  (PAM-CZT) . 

More  explicitly,  two  random  processes  that  are 
jointly  stationary  over  N  data  segments  are  processed 
as  follows  (Carter  and  Knapp  (1975)): 

1.  Kach  of  the  two  time  series  Is  segmented 
into  N  segments  of  P  points.  The  segments  may  either 

be  disjoint  or  overlapped.  Then  one  segment  of  P  data 
points  with  the  same  time  origin  is  selected  from  each 
of  two  time  records.  Even  if  each  of  the  M  data  segments 
is  large  (for  example,  greater  than  4096),  P  should  be 
selected  to  ensure  that  the  sampling  frequency  divided 
by  P  will  afford  adequate  spectral  resolution. 

2.  Each  of  the  two  P  point  segments  is 
multiplied  by  *  smooth  weighting  function  Here  smooth 
means  that  the  t-th  order  derivative  is  continuous  over 
the  full  Interval  of  data  points,  for  l»0,  1,  2,  ...  up 
to  some  reasonable  limit.  The  smoother  the  weighting 
function,  the  more  rapidly  the  side  lobes  of  its  Fourier 
transform,  or  window  function,  will  decay.  The  more 
impulse-like  the  window,  the  less  leakage  there  will  be 
of  extraneous  power,  which  corrupts  spectral  measurements. 
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Hence,  good  weighting  functions  result  in  better  spectral 
estimates.  The  price  paid  for  impulse-like  window 
functions  with  rapidly  decaying  side  lobes  is  a  wider 
main  lobe,  that  is,  poorer  frequency  resolution  when 
P  is  held  fixed.  Tf  better  resolution  is  desired,  more 
data  points  per  segment  will  be  required.  This  in  turn 
requires  both  that  the  data  be  available  and  that  they  can 
be  efficiently  processed.  Moreover,  from  a  stability 
point  of  view,  increasing  P  decreases  the  available 
number  of  Independent  data  segments  when  the  data  duration 
is  finite. 

The  specific  selection  of  a  weighting  function 
involves  a  number  of  tradeoffs.  A  commonly  used  weighting 
(or  windowing)  function  is  the  cosine  (Hanning)  function 
defined  at  the  p-th  instant  in  the  Interval  (O.P)  as 


such  a  function  starts  out  at  zero  for  p*0  smoothly  rises 
to  unity  by  p-P/2  and  smoothly  decays  to  zero  at  p«P. 

The  application  of  a  cosine-weighting  function, 
which  is  necessary  to  reduce  errors  due  to  side  lobe 
leakage,  has  the  disadvantage  of  apparently  wasting  the 
available  data.  This  apparent  wastage  can  be  overcome 
through  overlapped  processing.  In  particular,  Nuttall 
(1971)  has  shown  that  the  same  stability  (as  measured  by 
the  number  of  equivalent  degrees  of  freedom)  can  be 
obtained  from  a  fixed  amount  of  data  via  overlapped 
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processing  as  with  niackman  and  Tukey  (1958)  correlation 
processing  for  both  auto  and  cross  spectral  density 
estimation.  (Results  on  cross  spectra  processing 
followed  in  a  supplemental  report.) 

Quite  naturally,  there  is  an  increase  in 
computational  cost  associated  with  overlapped  processing. 
Specifically,  the  number  of  FFTs  to  be  performed  (a 
measure  of  the  computational  cost)  increases  with  the 
percent  overlap  specified.  For  example,  the  number  of 
FFTs  required  for  50-percent  overlap  is  approximately 
twice  the  number  for  O-percent  overlap.  Increasing  the 
overlap  from  50-percent  to  62.5  percent  requires 
32-rercent  more  FFTs.  For  Hanning  weighting,  the 
improvement  to  be  derived  from  using  62.5-percent  overlap, 
as  opposed  to  50-percent  overlap,  will  not  usually 
warrant  the  Increased  computational  costs  (Carter,  Knapp, 
and  Nuttall  (1973a)). 

Note  that  if  there  is  no  overlap,  each  segment 
would  be  virtually  Independent  of  the  previous  one 
(except  for  correlated  edge  effects).  Independent  data 
segments  facilitate  certain  analytic  computations.  Hence, 
all  theoretical  results  here  are  concerned  with  the  case 
of  independent  segments;  that  is,  no  overlap.  This  is 
true  even  though  overlapped  processing  is  recommended 
for  actual  data  processing.  The  amount  of  overlap 
desirable  can  be  predicted  by  picturing  the  apparent 
wastage  for  a  specific  weighting. 
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3.  The  transform  of  the  weighted  P-point 
sequence  is  evaluated  on  the  unit  circle  in  th»  z  plane. 

The  two  sided  Z-transform  of  an  infinite  sequence  is 
defined  by  Gold  and  Rader  (1969)  and  Oppenheim  and 
Schafer  (1975)  as 

69 

X  (z)  »  £  x (p)z"p,  n-1,2 . N  ,  ( A-l) 

U  a 

where  z  equals  any  complex  variable. 

Similarly,  Y  (z)  is  defined  as  the  Z-transform 

D 

of  yQ(p).  When  xQ(p),  yQ(p)  are  finite  in  duration,  the 

Infinite  series  (A-l)  becomes  finite.  Evaluation  of  the 

Z-transform  at  P  equally  spaced  points  around  the  circle 

yields  the  DPT: 

P-1 

Vk>“  E  «n(P)«'ja'pk/I>  .  <4-2) 

p-0 

Similarly,  YQ(k)  is  the  DPT  of  the  n-th  weighted  data 
segment  yQ(P) .  P"0,1, . . . ,P-1.  The  DPT  can  rapidly  be 
evaluated  by  two  methods:  the  Cooley-Tukey  (1965)  or  the 
PAM-CZT  (see,  for  example,  Rablner,  Schafer,  and  Rader 
(1969),  Schilling  (1972),  Perrle,  Nawrocki,  and  Carter 
(1973),  and  Carter  and  Knapp  (1975)).  The  PPT  is  a  fast 
algorithm  for  evaluating  the  DPT.  Xf  the  DPT,  (A-2), 
is  evaluated  for  P  frequencies  (k«0,l, . . . ,P-1)  it  requires 
P*  (complex)  iatltlplicatlons  and  additions  (MADs).  The 
PPT  uses  an  ingenious  computation  method  to  evaluate 
(A-2)  in  Just  Plog2P  MADs.  Thus,  for  P-4096,  the  number 
of  MADs  is  reduced  by  a  factor  of  more  than  340.  Thus, 
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computations  requiring  more  than  5  hours  can  be  done 
in  less  than  1  minute  using  FFTs  in  lieu  of  DFTs. 

Specific  details  of  the  FFT  are  beyond  the  scope  of 
this  dissertation. 

The  DFT,  (A-2),  is  a  special  case  of  the  CZT,  which 
was  introduced  by  Rabiner,  Schafer,  and  Rader  (1969) 
and  amplified,  including  software  implementation,  by 
Schilling  (1972)1  and  hardware  development  by  Alsup, 

Means,  and  Whitehouse  (1973),  and  Buss,  Collins,  Bailey 
and  Reeves  (1973).  Given  sufficient  data,  it  is  a  fast 
and  efficient  technique  for  computing  the  Z-transform  of 
a  sequence  on  any  Z-plane  spiral.  The  modified  CZT 
(MCZT)  evaluates  equispaced  frequency  points  on  the 
unit  circle  in  the  Z-plane.  With  proper  spacing  and 
starting  points,  it  is  equivalent  to  the  DFT. 
Computationally,  the  MCZT  requires  three  FFTs  each  of 
size  greater  than  N  (for  example,  2N)to  compute  the 
DFT,  (A-2).  However,  the  tradeoffs  are  really  more 
complex  than  this.  (For  example,  if  many  MCZTs  are 
to  be  performed  one  of  the  three  required  FFTs  does  not 
need  to  be  repeated  after  its  first  computation  since 
it  is  a  transformed  cosine  data  table.)  The  major 
advantage  of  the  MCZT  occurs  when  the  number  of  data 
points  P  (in  each  of  the  N  data  segments)  is  large. 

*This  work  was  brought  to  the  author's  attention 
by  Dr.  N.  Ahmed,  Kansas  State  University,  Manhattan, 

Kansas . 
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In  such  cases,  the  original  P  point  data  segment  can  be 
again  segmented  into  R  partitions  each  disjoint  with 
size  P/R  data  points.  The  R  partitions  are  processed 
with  R  UCZTs;  the  outputs  are  summed  together  with 
appropriate  phasing  to  achieve  a  PAM-CZT  that  is 
equivalent  to  the  DFT,  (A-2).  The  mathematical  details 
of  this  technique  are  covered  in  length  by  Ferrie, 

Nawrocki ,  and  Carter  (1975);  their  inclusion  here  does 
not  appreciably  add  to  the  discussion  but  does  considerably 
complicate  the  notation  due  to  conflicts  with  assigned 
symbols.  For  most  broad  band  cases  of  interest  (and 
certainly  the  example  case  in  Appendix  D),  the  rFT  will  be 
preferable  to  the  PAM-CZT.  A  complete  discussion  of  the 
tradeoffs  is  given  by  Carter  and  Knapp  (1975). 

Having  computed  the  DFT,  (A-2),  either  by  an 
FFT  or  PAM-CZT,  we  are  ready  to  proceed  with  the  fourth 
step  in  the  spectral  estimation  algorithm. 

4.  The  spectral  estimates  are 

N 

Gxx(k)  -  cg  £  |Xn(k)|2,  (A-3a) 

n»l 

*  N  2 

GyyOO  M  Cg  L  lYn(k)l  •  (A'3b) 

n«l 

N 

dxy(k)  "  cg  LX n(k)Y!(k),  (A-3c) 

n-1 


where  the  constant 


1 

r— 

■ 


( A-3d) 


e 


g 


and  f#  5  sampling  frequency.  (The  estimated  cross  spectrum 
(A-3c)  is  complex.)  The  estimate  of  MSC 


(k) 


is-<»>i2 

®xx(k)Syy(k> 


(  A-4) 


The  AML  estimation  of  time  delay  requires  substituting 

A 

the  estimates  C  in  place  of  the  true  (but  unknown) 

*y 

value  of  MSC.  Therefore,  we  are  concerned  about  the 
statistical  variability  of  the  MSC.  Further,  the 
statistical  characteristics  of  C  are  of  interest  in  their 
own  right,  since  6  is  useful  not  only  in  time  estimation 
(Chapter  3)  but  also  for  other  applications  (Chapter  2). 
Appendix  B  discusses  the  statistics  of  the  MSC  estimate. 
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where  N  is  the  number  of  date  segments  employed  and 

X„(k),  Y  fk)  are  the  DPTs  of  the  n-th  weighted  data 
n  n 

segments  of  x(t),  y(t),  respectively.  Under  certain 
assumptions  the  statistical  characteristics  of  C  can 
be  evaluated.  This  appendix  is  divided  into  four 
sections.  The  first  section  gives  the  pdf,  cumulative 
distribution  function  (6df)  and  m-th  moment  of  C ,  given 
C  and  N.  The  second  section  gives  the  bias  of  the 
estimate  C  including  a  discussion  of  when  the  analytic 
results  fail  and  simulations  to  support  the  theory. 

The  third  section  gives  the  variance  of  C.  The  fourth 
section  gives  a  computer  program  for  evaluating  receiver 
operating  characteristics  (ROC)  of  a  linearly 
thresholded  coherence  estimation  processor.  The 
results  in  all  four  sections  are  based  on  the  derivation 
by  Goodman  (1957)  of  an  analytical  expression  for  the 
pdf  of  the  MC  estimate  and  the  subsequent  extensions  to 
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MSC  by  Carter,  Knapp,  and  Nuttall  (1973a).  These 
results  are  based  on  two  zero-mean  stochastic  processes 
that  were  Jointly  stationary.  Gaussian,  and  had  been 
segmented  into  N  independent  segments*1  Each  segment 
was  assumed  large  enough  to  ensure  adequate  spectral 
resolution.  Further,  each  segment  was  assumed  perfectly 
weighted  (windowed),  in  the  sense  that  the  Fourier 
coefficient  at  some  k-th  frequency  was  to  have  "leaked" 
no  power  from  other  bins*  The  statistics  do  not  hold 
at  the  zero-th  or  folding  frequencies  (Hannan  (1970)). 
Extensions  to  Goodman's  work  are  given  by  Alexander  and 
Vok  (1963),  Amos  and  Koopmans  (1963),  Enochson  and 
Goodman  (1965),  Nettheim  (1966),  Wahba  (1966),  Tick 
(1967),  Carter  and  Nuttall  (1972),  Carter,  Knapp  and 
Nuttall  (1973b),  Halvorsen  and  Bendat  (1975), and  Nuttall 
and  Carter  (1976a). 

Bl.  Probability  Density.  Cumulative  Distribution 
and  a-th  Moment  of  £ 

The  first-order  pdf,  cdf  and  m-th  moment  of  the 
estimate  of  MSC,  given  the  true  value  of  MSC  and  the 
number ,  N,  of  independent  segments  processed,  are  presented 
in  this  section  in  closed  form. 
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Despite  the  fact  that  it  is  only  mathematically 
tractable  to  obtain  analytic  expressions  when  the  segments 
are  independent,  we  would  in  practice  use  sc~e  overlapped 
prooessing  to  regain  the  apparent  data  wastage  incurred 
by  the  necessity  of  data  weighting.  Carter,  Knapp,  and 
Nuttall  (1973a)  report  the  results  of  an  empirical  study 
that  demonstrates  how  bias  and  variance  decrease  as  a 
function  of  increased  data  segment  overlap.  Fifty  percent 
overlap  is  recommended  with  cosine  weighting.  j 

l 
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The  conditional  pdf  for  C,  between  two  processes, 
given  C  and  N,  is  (Carter,  Knapp,  and  Nuttall  (1973a)) 

p(C|N,C)  -  (N-1)(1-C)N(1-C)N'2  (1-CC)1’2N2F1(1-N,1-N;1;CC). 

(B-2) 

The  2*1  is  R  hyper geometric  function  with  two  numerator 
terms  and  one  denominator  term.  (It  is  a  snecial  case  of 
(B-7)  and  is  discussed  more  fully  in  Section  B4.)  For 
present,  we  note  equation  (B-2)  is  desirable  because 
jFj ( 1-N , 1-N ; 1 ; CC )  can  be  expressed  as  an  (N-l)st  order 
polynomial  (Abramowitz  and  Stegun  (1964),  Equation  (15. 5.1)). 

A  special  case  of  the  density  function  occurs  when 
C-0.  In  that  event, 

p(C|N,C-0)  -  (N-1)(1-C)H“2  .  (B-3) 

Using  a  result  of  Fisher  (1950),  Carter,  Knapp,  and 
Nuttall  (1973a)  have  determined  (in  closed  form)  the 
cumulative  distribution  of  the  estimate  of  NSC,  namely, 

P(C|N,C)-C^7j  (B~4) 

A  digital  computer  program  to  evaluate  equation  (B-4) 
is  given  in  Section  B4.  In  the  special  case  when 
C«0,  the  cdf  can  be  simplified  to  give 

P(C|N,C-0)  -  l-(l-e)N-1  .  (B-5) 

Equation  (B-5),  when  differentiated,  yields  the  pdf 
equation  (B-&). 

The  m-th  moment  of  the  NSC  estimate  can  be  found  by 
application  of  Equation  7.512(12)  by  Gradshteyn  (1965)  to 
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a  different  form  of  (B-l)  to  yield  (Carter,  Knapp,  and 
Nuttall  (1973a)) 


BI(Cb|N,C)]-  (1-C)N 


3F2(bH-1,  M,  N;  m+N,  1;C)  .  (B-6) 

These  results  can  be  confirmed  using  Carter  (1972a)  and 
Anderson  (1953). 

The  37g  hypergeometric  functions  (with  three 
numerator  terms  and  two  denominator  terms)  are  given  by 


3P2(a,b,c; 


d.e; 


z)  ■  £ 
k-0 


(s)k(b)k(c)k  zk 
(d)k^*)k  ^ 


(B-7a) 


where  the  (a)k  notation  is  Pochhaomer' s  symbol  (Abramowitz 
and  Stegun  (1964))  defined  by 


(B-7b) 


where  T(  )  is  the  Gamma  function.  Similarly,  the  F  two- 
one  function  has  two  numerator  and  one  denominator  terms. 

B2.  Bias  of  6 

This  section  deals  with  the  bias  of  the  HSC  estimate. 
Exact  and  approximate  expressions  are  presented.  In 
addition,  computer  evaluation  of  the  exact  expressions 
Is  presented  to  lend  meaning  to  these  results,  and  two 
computer  simulations  are  presented.  The  first  simulation 
demonstrates  the  need  to  have  adequate  spectral  resolution. 
The  second  simulation  verifies  the  theoretical  results 
for  bias  (and  also  variance,  which  is  discussed  in  the 
next  section,  B3). 
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Consider  now  the  first  moment  of  the  estimate  of 
KSC  which  cun  be  written  as 

IlfijH.C]  -  £jj£)N  3F2(2,N,N;N+1.1;C)  ,  (B-8) 

which  can  be  manipulated  Into  the  form  (Carter  (1972a)) 

B(C|H,C)  *  |  ♦  fel  C  gF^l.lsK+a'.C)  .  (B-9) 

The  bias  or  expected  estimation  error  Is  defined 

as 

Bias  -  B(C|N,C)  -  I(C|H.C)  -  C  .  (B-10) 

An  exact  expression  for  the  bias  Is 

B(C|W.C)  -  f  C  jFjd.ljN+ajO-C  .  (B-ll ) 

The  maximum  bias  Is  1/H  (regardless  of  N  and  C).  The 
bias  Is  plotted  In  Figure  B-l.  It  should  be  noted  that 
11m  (Bias)  -  0  ;  (B-12) 

therefore,  the  estimator  may  be  referred  to  as  asymptotically 
unbiased.  By  expanding  in  (B-ll)  In  a  power  series 
la  C  and  retaining  terms  to  order  If  ,  the  following 
approximation  Is  obtained  (Rut tall  and  Carter  (1976b) ): 

B1(C.H)  •  J(1  -  C)2(l*  .  (B-13) 

Plots  of  N  B(C,N)  and  If  B1(C,IV)  are  presented  in  Figure 
B-2  tor  N«4  (they  cross  near  C«0.4).  Approximation 
(B-13)  Is  seen  to  be  excellent  over  the  entire  range  of 
C.  Furthermore,  the  .discrepancy  between  the  approximation 
(B-13)  and  the  true  bias  (B-ll)  is  even  less  for  larger 
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values  of  N. 

For  largo  N,  (B-13)  la  further  reduced  to  the 
approximation  given  by  Carter,  Knapp,  and  Nuttall  (1973a): 

B2(C,N)  -  jf(l-C)2;  good  for  large  N  .  (B-14)  * 

Therefore,  as  If  leads  to  infinity,  N  B(C,N)  tends  to 
(1-C)  ,  which  is  also  plotted  in  Figure  B-2;  furthermore, 
the  approach  is  monotonic. 

In  Benignus  (1969a),  (2),  an  approximate  expression 
for  the  bias,  based  upon  a  simulation  approach,  is 
presented  as 

B3(C.II)  -  |(1-C)  .  (B-15) 

Whereas  the  results  in  Haubrlch  (1965)  and  (B-14)  dictate 
a  quadratic  behavior  for  bias,  the  approximation  by 
(B-15)  indicates  a  linear  behavior.  Since  (B-ll)  through 
(B-14)  is  based  upon  theory  and  (B-15)  is  based  upon 
simulation,  it  was  decided  to  verify  (or  invalidate) 

(B-ll)  through  (B-14)  by  a  simulation  approach.  Two 
computer  simulations  were  conducted. 

In  order  to  verify  the  theory,  the  simulation  must 
preserve  those  assumptions  present  in  the  derivation 
of  the  theoretical  expression  (B-ll)  for  bias.  Specifically, 
as  pointed  out  by  Carter  and  Knapp  (1975),  (B-ll)  holds 
under  the  following  assumptions: 

1.  jointly  Gaussian  stationary  processes 

2.  N  independent  (con  overlapped)  data  segments 
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3.  smooth  weighting  function  to  reduce  side 


lobe  leakage 

4.  adequate  frequency  resolution 

When  any  of  the  specified  assumptions  are  violated, 

analytic  results  derived  for  bias  (and  variance)  of 

the  estimator  can  be  grossly  misleading.  (The  Gaussian 

part  of  the  first  assumption  is  weak;  see  the  discussion 

after  (3-3).)  As  an  empirical  verification  of  this 

statement,  consider  the  study  reported  by  Carter  and 

Knapp  (1975),  where  C  (f)  ■  l,¥f.  Specifically,  consider 

*y 

a  simple  linear  second-order  digital  filter  of  the  form 
Y  -  1 . 97300Y  ,  -  0 . 98202Y  ,  ♦  0.00872X  •  (B-16) 

D  D-l  usd  n 

The  system  behavior  was  studied  by  probing  the  filter 
with  a  white  pseudorandom  noise  source.  The  sampling 
rate  was  set  equal  to  2048  Hs;  hence,  the  Nyquist  rate 
of  «  radians  is  depicted  as  1024  Hz  in  tbs  figures  that 
follow. 

The  filter  phase  characteristics  were  estimated. 
Figure  B-3 ,  with  P-1024,  cosine  weighting,  and  64 
Independent  segments.  Despite  the  fact  that  the  MSC 
between  input  and  output  should  equal  unity  (hence,  the 
bias  of  the  estimator  would  normally  be  zero),  the 
estimate  of  MSC  is  grossly  biased  when  a  rectangular 
weighting  function  is  used.  Specific  MSC  estimates  arp 
depicted  i q  Figure  B-4  for  the  rectangular  weighting 
case.  The  bias  attributable  to  improper  windowing,  while 


severe,  can  be  substantially  eliminated  through 
selection  of  a  leakage-suppressing  window.  When  a 
cosine  or  Hanning  window  is  utilized  and  the  data  are 
reprocessed,  estimates  depicted  in  Figure  B-5  are 
obtained.  Notice  now  that  the  bias,  though  greatly 
improved,  still  exists  in  the  vicinity  of  30  Hz. 

Referring  to  Figure  B-3 ,  notice  that  30  Hz  is  the  center 
of  a  frequency  band  in  which  the  first  derivative  of  the 
phase  Is  large.  The  dependence  of  the  bias  of  the  MSC 
estimate  on  this  characteristic  of  phase  Is  predicted  in 
Jenkins  and  Vatts  (1968),  Hannan  (1970),  and  Koopmans 
(1974). 

Once  sufficient  resolution  has  been  achieved,  this 
bias  no  longer  exists.  To  determine  whether  the  bias 
in  Figure  B-3  could  be  reduced  by  more  averaging,  as 
analytically  predicted  by  the  approximation  in  Jenkins 
and  Vatts  (1968),  additional  independent  data  segments 
were  processed  in  the  simulation  (that  is,  N  was  made 
larger  without  changing  P).  In  this  case  of  insufficient 
resolution,  the  maximum  bias  error  was  observed  to  be 
independent  of  the  number  of  segments  averaged;  that  is, 
the  estimator  is  biased  as  N-*~  when  the  number  of  data 
points  per  segment  is  small. 

Vhen  large  amounts  of  data  are  used,  as  in  the  case 
of  a  computer  simulation,  better  resolution  can  be 
obtained  without  loss  of  averaging  (variance  reduction) 
capability.  However,  when  the  data  are  of  limited 


duration  then — dependent  on  the  length  of  actual  data 
cute  and  the  stationarity  of  events  over  that  duration — 
another  method  can  be  employed  to  improve  MSC  estimation 
in  the  Taco  of  rapidly  changing  phase  angles.  These 
methods  are  referred  to  as  alignment,  or  translation 
methods,  and  are  used  to  remove  the  time  delay  or  group 
delay  of  a  filter.  Translation  (that  is,  prefiltering 
by  a  single  time  delay)  of  one  time  series  with  respect 
to  another  permits  the  rate  of  change  of  the  phase  in  a 
particular  frequency  band  to  be  controlled  and  reduced 
to  yield  better  MSC  estimates  in  that  frequency  band. 

The  implication  is  that  MSC  estimates  are  valid  in 
frequency  bands  where  the  phase  has  little  or  no  slope. 
Various  methods  for  estimating  the  time  delays  are 
discussed  in  Chapter  4. 

Translation  was  applied  to  align  the  time  series 
for  the  example  presented  here.  After  alignment, 
unbiased  estimates  were  obtained  in  a  20  Hz  band  about 
30  Hz;  however,  as  expected,  outside  that  band,  biases 
were  severe,  making  interpretation  meaningless.  In 
general,  translation  must  be  applied  for  "all"  time 
delays  and  the  results  combined  into  one  result  (graph); 
hence,  when  sufficient  data  are  available,  the  author's 
preference  is  for  finer  frequency  resolution  rather  than 
for  the  piecemeal  approach  which  may  be  dictated  for 
reasons  of  limited  data  or  limited  stationarity .  In  the 

A 

latter  case  (of  P  sufficiently  large),  C  will  not  depend  on  D. 
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The  example  used  here  exhibited  biases  of  one 
tenth  (see  Figure  B-5);  furthermore  the  trend  was 
clearly  indicative  of  the  fact  that  any  bias  (less 
than  one)  could  be  expected  with  insufficient  frequency 
resolution  even  when  as  many  as  64  independent  data 
segments  have  been  processed  (Carter  (1972b)).  The 
practical  implication  of  this  limitation  is  that  it  is 
highly  desirable  that  the  actual  number  of  data  points 
per  segment,  P,  be  large.  For  a  finite  duration  data 
set,  this  will  mean  Increased  instability  in  the 
estimator  (that  is,  smaller  N  and  hence  larger  variance). 
It  should  be  noted  that  one  cannot  simply  increase  P 
by  adding  zeros  or  by  increasing  the  sampling  rate 
of  the  original  data,  for  then  no  additional  information 
content  is  added.  Quite  the  contrary,  the  minimum  data 
sampling  rate  should  be  selected,  for  this  ensures 
the  maximum  amount  of  actual  time  per  data  segment  for 
a  given  value  of  P.  Good  resolution,  that  is,  large 
P,  apparently  requires  computation  of  a  large  size  FFT. 

An  alternative  computation  that  reduces  the  required 
FFT  size  is  the  PAM-CZT  (Appendix  A). 

The  results  of  the  first  simulation  show  two  critical 
things:  first,  when  estimating  MSC  (or  any  spectral 
quantities)  it  is  Important  to  use  both  smooth  weighting 
functions  and  adequate  frequency  resolution.  Second, 
simulation  experiments  to  validate  expressions  for  bias 
of  C  can  give  misleading  results  due  to  the  sensitivity 


169 


■ :  •  'v  ^ 

•  *  '.i  1 ,  1  1  v  v. 


of  the  four  fundamental  assumptions  upon  which  the  theory 
rests.  Another  difficulty  in  experimentally  estimating 
bias  is  that  when  the  assumptions  do  hold,  the  bias  is 
a  small  quantity  to  measure.  For  example,  for  - 
00.3,  032,  we  find  B(C,N)-0.01S6.  However,  the 
standard  deviation  of  6  is  approximately  0.3.  (See 
Section  3  of  Appendix  B. )  Thus  a  large  number  of 
Independent  trials,  in  each  of  which  C  is  computed, 
must  be  used  in  order  to  obtain  a  sample  mean  that  has 
statistical  significance.  Ve  use  10,000  different 
Independent  trials  at  each  value  of  OO  ( .  1 ) .  9 ;  the 
results  of  Benignus  (1969a)  employed  less  than  1,000 
trials. 

Lastly,  the  smallness  of  the  bias  dictates  that  the 
desired  value  of  C  be  accurately  realized  in  the  simulation. 
As  an  example  of  the  danger  of  not  doing  so,  consider 
the  following:  suppose  we  believe  we  have  generated 
processes  with  a  desired  coherence  of  0.300,' and 
subsequently  observe  a  sample  mean  of  0.315;  in  such  a 
situation,  the  estimated  bias  is  0.015.  But  if  the 
generated  coherence  is  not  precisely  under  the 
experimenter's  control  and  is  off  by  only  1  percent 
(giving  rise  to  a  true  coherence  in  this  example  of 
0.303),  then  the  bias  should  have  been  reported  as 
0. 315-0. 303«0. 012.  Thus,  a  1  percent  error  in  true 
coherence  gives  rise  to  a  25  percent  error  in  estimated 
bias  in  this  example.  We  generate  our  correlated 
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processes  according  to 

x(t)  -  a(t)  ,  (B-17a) 

y(t)  -  b(t)  ♦  ga(  t),  (B-17b) 

where  a(t)  and  b(t)  are  uncorrelated  complex  Gaussian 
processes,  and 

g  -  (B-18) 

The  statistical  characteristics  of  C  in  (B-l)  are 
derived  on  the  fact  that  X(k)  and  Y(k)  are  Gaussian. 

This  will  be  the  case  if  x(t)  and  y(t)  are  Gaussian; 
however,  the  essence  of  the  theory  does  not  require 
X(k)  and  Y(k)  to  be  DFT  outputs  but  merely  complex 
Gaussian  random  variables.  Thus,  we  can  simply  avoid 
the  Issues  of  weighting  and  frequency  resolution  by 
simulating  the  DFT  outputs  directly;  this  technique 
reduces  the  cost  of  the  experiment  (and  indeed  will 
verify  the  theory).  The  essential  features  of  the 
simulation  are  given  in  Figure  B-6. 

The  results  of  the  simulation  for  N«4  are  superposed 
in  Figure  B-7  on  the  exact  bias  curve.  . 

In  particular,  the  sample  mean  of  10,000  independent 
trials  at  each  value  of  C»0(.l).9  is  plotted,  along  with 
a  vertical  bar  between  the  +o  points  of  the  random 
variable.  In  seven  out  of  the  ten  cases  of  selected 
MSC,  the  +0  *polnts  bracket  the  theoretical  curve,  and 
the  remaining  three  out  of  ten  are  Included  within  the 
+2o  pointe.  The  possibility  of  (B-15)  falling  within 
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Figure  B-6  Flow  Diagraijj  for  Empirical  Determination 
of  Bias  of  C;  N-4 ;  10,000  Trials 
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these  tolerances  Is  completely  ruled  out.  Thus,  the 
simulation  confirms  the  theoretical  result  in  (B-ll) 
and  rules  out  the  approximation  In  (B-15). 

Since  »e  have  a  simulation  technique  which  corroborates 
the  theory  so  well,  it  is  possible  to  employ  it  to 
Investigate  other  more  complicated  functions  of  C 
which  are  very  difficult  (if  not  impossible)  analytically. 
In  particular,  we  use  a  bootstrap  idea  based  upon  that 
of  Benignus  (1969a)  in  an  attempt  to  reduce  the  bias 
of  the  coherence  estimate.  Namely,  we  consider  a 
modified  estimate  of  M8C  as 


A 

c 


(B-19) 


where  we  have  estimated  the  bias  by  means  of  (B-13)  and 
the  initial  estimate  C  of  M8C.  The  reason  for  the 
0  in  (B-19)  is  that  we  are  unwilling  to  accept  negative 
estimates  of  coherence.  (Without  the  0  in  (B-19)  we 
can  reduce  the  bias  further  at  the  expense  of  added 
variance.)  The  estimated  bias  and  variance  of  C  and 

A 

C  are  presented  in  Table  B-l.  It  is  observed  that  the 
bias  of  C  is  significantly  reduced.  However,  the 
variance  is  increased.  In  fact,  the  estimated  mean 
square  error  (BSE)  (which  equals  the  variance  plus  the 
square  of  the  bias)  is  presented  in  Table  B-l  and  is 

A 

greater  for  C  than  for  C  when  C  is  greater  than  0.3; 
the  opposite  behavior  holds  when  C  is  less  than  0.3. 
(For  N»4,  C«0.3  is  the  crossover.)  Thus,  the  choice 
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between  the  two  estimators,  C  and  C,  depends  on  whether 
one  Is  bothered  more  by  bias  or  MSE. 

A 

For  larger  N,  the  crossover  value  of  C,  at  which  C 

A 

A 

or  C  has  less  MSE ,  decreases.  For  example,  at  N-8, 
it  was  observed  to  occur  at  C-0. 2.  Thus,  for  practical 
useful  values  of  N  (which  are  usually  much  larger  than 

A 

1),  the  estimator  C  will  have  less  MSE  than  C  over  almost 
the  whole  range  of  C  and  will  probably  be  preferred. 

Also,  the  bias  is  quite  small  for  large  N.  The  variance 

A 

of  C  is  discussed  in  the  next  section.  Under  the 
assumptions  of  smooth  weighting  functions  and  adequate 
frequency  resolution,  we  will  see  variance  is  a  more 
significant  problem  than  bias.  However,  as  seen  In  this 
section,  when  the  assumptions  are  violated,  the  bias 
can  be  a  significant  source  of  estimation  error. 

B3..  Variance  of  C 

An  exact  expression  fo-r  the  variance  of  C  is 
Carter  (1972a): 

V  .  2  fr~c)W  -F2(3,  N,  N;N  +  2,  1;  c) 

N(N  ♦  1)  4  / 

-  [^5^*  *  i.  i!  c)]2 

(B-20)  is  plotted  in  Figure  B-8.  For  the  special  case 
of  C-0, 

v  '  -  ®2-  5^777  '  c*°  '  <B-n,) 


(B-20) 


and 


■  -4  ,  for  large  N  and  C-0. 
IT 


( B-21b ) 
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Por  large  N  and  C^O, 


which  has  a  maximum  value  of  8/27N*0.30/N  at  C*l/3. 

Thus  the  maximum  variance  is  always  less  than  0.30/N 
regardless  of  the  value  of  C.  Hence,  the  variance  of 
the  estimator  in  the  case  where  C  is  unknown  (but 
nonzero)  decreases  Inversely  proportional  to  N.  Ve 
note,  by  inspecting  (B-20),  that  for  larger  and  larger 
N,  (B-22)  becomes  a  better  and  better  approximation. 

Since,  in  general,  we  do  not  know  the  true  value  of 
HSC,  we  select  N  based  on  a  worst  case  (maximum  variance) 
analysis. 

Provided  we  have  used  good  weighting  functions  and 
good  frequency  resolution,  the  variance  has  a  more 
serious  effect  than  bias.  Por  example,  if  01/3  and 
N»100,  then  the  bias  of  C  is  less  than  0.01,  while  the 
standard  deviation  (square  root  of  the  variance)  is 
approximately  equal  to  .05.  Hence,  even  when  100 
independent  segments  are  processed,  the  HSC  estimate 
still  has  significant  variability. 

B4.  Receiver  Operating  Characteristics  for  a  Linearly 
Thresholded  Coherence  Estimation  Detector 

An  algorithm  for  computing  the  ROC,  or  the 
probability  of  detection,  Pp,  versus  the  probability 
of  false  alarm,  Pp,  for  a  linearly  thresholded  HSC 
estimation  detector  is  presented  together  with  an 
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example  of  a  ROC  table1  (Carter  (1976).  A  recent 
article  (Gevins,  Yeager,  Diamond,  Spire,  Zeitlin,  and 
Gevins  (1975))  presents  new  results  on  using  linearly 
thresbolded  MSC  estimates  to  detect  biomedical 
phenomena.  The  desire  to  establish  a  threshold  below 
which  MSC  estimates  are  not  presented  to  a  human 
decision  maker  is  an  important  issue  in  certain  areas, 
such  as  brain  wave  analysis  and  sonar,  where  the  volume 
of  sensor  data  is  large.  For  a  fixed  amount  of 
averaging  and  a  fixed  threshold  value,  E,  in  the 
absence  of  a  coherent  source,  there  is  still  a  certain 
probability,  Pp,  that  an  MSC  estimate  will  exceed  the 
threshold.  Moreover,  although  the  false  alarm  rate 
can  be  reduced  by  increasing  E,  to  do  so  decreases  PQ, 
when  a  coherent  source  is  present.  How  much  it 
decreases  PD  will  depend  on  the  strength  of  the  coherent 
source,  that  is,  the  true  or  underlying  coherence  that 
is  being  estimated.  This  section  presents  an  algorithm 
for  computing  PD  versus  Pp  for  a  specified  amount  of 

A 

averaging  and  underlying  coherence.  The  pdf  of  C, 
when  C*0,  is  (from  (B-3)): 

p(C|N,  C-0)  -  (N-1)(1-C)(N“2)  .  (B-23) 


1The  idea  for  computing  ROC  curves  was  suggested 
to  the  author  by  R.  Trueblood,  Naval  Undersea  Center, 
San  Diego,  California. 
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Hence,  the  probability  of  false  alarm  is 

£ 

Pp  -  1  -  /  (N-l)(l-C)(N’2)dC  l B-24 ) 

r  0 

or 

E  -  1  -  exp[ log(Pp)/(N-l)l ;  (B-25) 

that  is,  for  a  specified  Pp  we  establish  a  threshold 
according  to  (B-25).  Now  the  computationally  more 
complex  question  is:  What  probability  of  detection  is 
achieved  for  this  threshold  value  E?  The  answer,  for 
a  given  value  of  C,  is 
1 

P D  -  /  p(C | N ,C)  dC-1  -  P(C<E|N,C)  ,  ( B-26 ) 

E 


A 

where  P(C4E|N,C)  is  the  cdf.  The  cdf  is  given  by  (B-4), 
namely. 


P(C<E|N,C) 

where 


N-2 
R  Z 

i-o 


2F1('£’ 


1  -N ;  1 ;  Z  ) 


(  B-27a) 


Z  •  EC 


(B-27b) 


(B-27c ) 


2?^  is  the  hypergeometric  function. 

The  hypergeometric  function  is,  in  general,  an  infinite 
series;  however,  for  negative  integers,  it  is  given  by 
equation  (15.4.1)  of  Abramowltz  and  Stegun  (1964)  as 

1 

„F  (-l,l-N;l;Z)  ■  I  T.  ,  ,B-28a) 

21  k?0  k 


where 
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Tk - ii)kH  '  <B-28b> 

Pochhammer's  Symbol  (z)^  (p.  236  of  Abramowitz 
and  Stegun  (1964)) 

(*V  •  (B-28C) 

and  where  the  Gamma  function  is  given  by  Hankel's 
Contour  integral  (p.  255  of  Abramowitz  and  Stegun  (1964)) 
as 

r(2)  -  ^^C-t)*Vtdtj  \  |z|<--  (B-28d ) 

Tbe  path  of  Integration  starts  at  +«•  on  the  real  axis, 
circles  the  origin  in  the  counterclockwise  direction, 
and  returns  to  the  starting  point.  However,  (B-27) 
can  be  computed  without  resort  to  complex  Integration 
methods  (even  when  the  real  part  of  z«0)  by  noting  for 
k  an  integer  that  Pochhammer ' s  Symbol, 

(z)k  ■  Jz(z+l)(z+2) . . . (z+k-1)  ,  k>0 

(l  k-0  ,  (B-29) 

is  tKe  product  of  k  Incrementally  Increasing  terms. 

Now  in  (B-28b)  when  ZaEC^0,  the  first  term  TQal  and 
the  ratio  of  the  k«th  to  tbe  (k-l)-st  term  is 

£  .  (B_30) 
Tk-i  ka 

Now  each  term  in  the  sum  can  be  computed  from  the 
^  previous  term  in  a  simple  fashion.  Indeed,  the  actual 
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computations  can  be  implemented  in  BASIC  on  the 
Hewlett-Packard  9830A  desk  top  calculator  in  less  than 
30  lines  of  code,  Figure  B-9.  For  models  of  the  form 

x(t)  »  aCO+n^t)  (B-31a) 

y(t)  •  s(t*D)+n2(t)  ,  (B-31b) 

where  s(t),  n^(t),  and  n2(t)  are  mutually  uncorrelated, 
and  when  G„  _  (f)-Gn  _  (f)-Gnri(f).  the  SNR  is 

njiij  n2n2  nn 


More  generally,  if 

x(t)  •  z^tl+n^t) 
y(t)  -  z2(t)+n2(t)  , 


(B-32) 


(B-33a) 

(B-33b) 


where  zA(t)  is  the  output  of  a  linear  filter  Hi(f) 
excited  by  s(t),  i-1,  2  and  the  noises  are  mutually 
uncorrelated  and  uncorrelated  with  the  signal,  then  it 
can  be  shown  that  (2-86) 


Cxy(f)-Csx<f)Csy<f)  ’  (B"34) 

that  is,  the  coherence  between  two  receivers  is  the 
product  of  the  coherence  between  the  source  and  each 
of  the  individual  receivers  for  the  model  (B-33). 
Substituting  for  the  model  in  (B-33)  results  in 


Gz  z  (f) 
2121 

G_  „  <n 

nlnl 


Gz  z  (f> 
Z2Z2 


(B-35) 


*  G"2»2<0  '  [^t%-CsyU] 


Now  if  Csx(f)-Csv(f)-|Cjfv(f) 


sy 


If*/”]1 


/  2 


then  it  follows 


.  M 
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10  H-8 

20  Nl-N-1 
30  N2-N-2 

40  A-l-N 
50  c*0  25 

60  PRINT  "THIS  RUN  IS  FOR  N-"N"  AND  MSO"C 
70  FOR  Fl-0.04  TO  1  STEP  0.04 
80  E-1-EXP(L0G(F1)/N1) 

00  Z*E*C 

100  C4-(l-E)/(l-Z) 

110  C2*I*( (1-C)/(1-Z) )tN 
120  8*0 

130  FOR  L*0  TO  N2 
140  C3-C4+L 
150  T-l 
160  F*1 

170  IF  (L-0)  THEN  230 
180  FOR  K-l  TO  L 
190  Kl-I-1 

200  T-T*(A+X1)*(K1-L)*Z/<K*X) 

210  F-F+T 

220  NEXT  K 

230  S-S+C3*F 

240  NEXT  L 

250  P*C2*S 

260  FIXED  3 

270  PRINT  E;F1 ;P, 1-P 

280  NEXT  FI 

290  END 


Figure  B-9  Computer  Program  to  Compute  ROC  Tables 


»*•  r’r 


fjr, 


vv: 


.I'irvi'vt 


fl  8388 


that  SNR  is 


G.  «  (f>G*  z  <f> 

zlzl  z2 2 


11/2 


5T77T)3— TTT 

l“l  n2n2 


vszz > 


xy 


) 


(B-36) 


Hence,  for  modal*  of  tha  form  of  (B-31)  or  (B~33)  if 
wa  want  to  look  at  tha  0  dB  (or  aqual  SNR  case),  we 
must  select 


10  log10  l-^l-  0  ,  (B-37) 

which  implies  00.25.  Now  suppose  we  average  for 
only  N-8  independent  data  segments.  Then  for 
Py»0. 04 (0.04) 1.00,  the  thresholds,  Py,  cdf  and  PD 
are  given  in  Table  B-2 .  If  a  sufficient  amount  of 
stationary  data  exists,  effective  performance  can  be 
Improved  by  increasing  N;  if  not,  N  can  only  be 
Increased  at  the  expense  of  degrading  the  frequency 
resolution  with  its  inherent  difficulties.  For  many 
problems,  N»8  will  be  too  small  and  Py-0.04  will  be 
too  large  or  the  performance  will  be  desired  for  a 
different  value  (or  family  of  values)  of  C.  Example 
plots  are  given  in  Figures  B-10  and  B-ll;  more 
extensive  results  can  be  obtained  by  modifying  the 
program,  Figure  B-9. 
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Table  B-2. 

Threshold,  Pp, 

cdf,  and  P 

THIS  RUN  IS  FOR  N-8 

AND  MSC 

9-369 

9  949 

9-696 

9-393 

9-989 

9-473 

9-261 

9-129 

9.389 

9-239 

9-169 

9-327 

9-295 

9-299 

9-279 

9-184 

9-249 

9-249 

9-166 

9-289 

9-298 

9-159 

9-329 

9-181 

9-136 

9-369 

9.157 

9-123 

9-499 

9-137 

9-111 

9-449 

9-U9 

9-199 

9-489 

9.194 

9-989 

9.529 

9-999 

9-979 

9-569 

9-978 

9-979 

9-699 

9- 966 

9-962 

9-649 

9-957 

9.954 

9.689 

9-948 

9-946 

9-729 

9-939 

9-938 

9-769 

9-932 

9-931 

9.899 

9-925 

9.925 

9-849 

9-919 

9- 918 

9-889 

9-914 

9.912 

9.929 

9-999 

9-996 

9-969 

9-994 

9-999 

1.999 

9-999 

9-394 

9-527 

9-611 

9-673 

9-721 

9-760 

9-792 

9-819 

9-843 

9-863 

9-881 

9-896 

9-919 

9-922 

9-934 

9-943 

9-952 

9-961 

9-968 

9-975 

9-981 

9-986 

9-991 

9-996 

1.999 
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APPENDIX  C 

COMPUTER  PROGRAM  FOR  SPECTRAL 
AND  TIMS  DELAY  ESTIMATION 

This  appendix  in  divided  into  two  eections.  The 

first  section  is  a  brief  program  description.  The  second 

section  is  a  complete  listing  of  the  main  program  and 

subroutines  necessary  for  program  execution. 

Cl.  Program  Description 
The  main  program  estimates  the  auto  and  cross 
spectral  density  functions.  These  spectral  estimates  are 
used  by  the  subroutine  PRCE3  to  estimate  six  different 
AML  estimates  for  time  delay  (See  Table  4-1  of  the  main 
text.)  Facilities  with  spectral  estimation  programs 
can  simply  augment  their  computations  with  a  call  to 
PRCE3.  Facilities  without  spectral  estimation  algorithms 
will  be  able  to  use  the  programs  listed  in  Section  2  of 
this  appendix.  The  programs  listed  are  Intended  to  be 
general  FORTRAN  IV  programs;  they  have  been  compiled 
and  executed  on  the  Univac  1108,  the  Control  Data 
Corporation  (CDC)  6600  and  International  Business  Machine 
(IBM)  360.  The  spectral  estimation  programs  have  been 
used  for  research  projects  by:  Williams  (1971),  Carter 
(1972a)  and  (1972b),  Brady  (1973),  Carter,  Knapp,  and 
Nuttall  (1973a).  Carter,  Nuttall,  and  Cable  (1973), 
Santopietro  (1973),  Carter  and  Knapp  (1975),  and  Appendix  D 
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of  this  dissertation.  These  research  projects  were 
conducted  entirely  on  the  Univac  1108  and  a  significant 
program  rewrite  waa  undertaken  to  make  the  programs 
more  transferable  from  one  computer  system  to  another.1 
The  programs  as  a  complete  data  processing  system 
consist  of  input,  computations  and  display.  Ve  have 
concentrated  our  rewrite  efforts  on  the  computations; 
both  the  input  and  display  programs  are  expected  to 
contain  peculiarities  of  the  particular  computer  being 
used.  The  input  and  display  subroutines  are  modular 
so  that  only  a  minimum  rewrite  is  required  to  transfer 
the  program  to  another  installation.  The  function  of 
the  input  subroutine  LOAD  is  to  load  the  XX  and  YY  arrays 
with  NNN  data  points.  If  the  data  were  stored  on  logical 
magnetic  tape  number  6  in  binary  format  the  call  to 
LOAD  could  be  replaced  by  the  FORTRAN  statement 
"READS.  XX(I),  YY(  I  )  ,  I-i  ,  NNN*’ . 

The  subroutine  LOAD  listed  in  Section  2  is  used  to 
generate  synthetic  data  for  a  suitable  test  cc.se 
(though  not  the  example  for  Appendix  D).  The  display 
subroutine  DPLOT  is  called  either:  (1)  to  initialize  the 
plotter,  (2)  to  plot  the  specified  array,  or  (3)  to 
terminate  plotting.  The  subroutine  listed  in  Section  2 
is  written  for  the  Stromberg  Carlson  4060  plot  system. 

It  must  be  rewritten  for  other  systems.  If  a  facility 

*The  programs  originally  written  and  documented  by 
C.R. Arnold,  G.C. Carter,  and  J.F.Ferrie,  have  been  rewritten 
and  tested  oy  J.C.Sikorski , G.C. Carter  and  Dr.  R.G. Williams. 
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has  no  plotting  system,  the  subroutine  should  simply  be 
s  subroutine  which  returns;  alternatively,  the  subroutine 
could  print  the  XX  array  for  I-ISTRT  to  I STOP.  Thus, 
for  use  at  a  new  site,  two  subroutines  (LOAD  and  DPLOT) 
need  to  be  rewritten. 

The  main  program  also  calls  (in  addition  to 
DPLOT  and  LOAD):  HZdlP,  TFT,  LIST,  LIST2,  PRCES,  and  LREMV. 
The  subroutine  LREMV  computes  (and  optionally  removes) 
the  linear  trend  and  dc  for  the  input  time  waveforms. 

These  computations  are  performed  for  every  time  segment 
and  are  printed  out  by  the  main  program  as  an  aid  to 
detecting  nonetationaritles  or  digitizing  errors.  The 
subroutines  LIST  and  LIST2  are  used  to  print  out  (list) 
results.  The  subroutine  FIT  computes  the  FFT  (see,  Tor 
example,  Cooley-Tukey  (1965));  coded  and  listed  by 
Singleton  (1969).  Singleton's  mixed  radix  algorithm  has 
boen  shown  by  Ferrle  and  Nuttall  (1971)  to  be  significantly 
Tauter  (though  less  accurate)  than  other  proposed  FFTs. 
Singleton's  600  line  FORTRAN  subroutine  can  be  replaced 
with  shorter  programs  (see,  for  example,  p.  332  of 
Oppenheim  and  Schafer  (1975)).  Because  of  the  availability 
of  Singleton's  listing  in  the  literature,  the  FFT  is  not 
listed  here.  Note  that  the  subroutine  PRCES  and  the  main 
program  presume  that  the  FFT  output  array  is  subscribed 
from  1  to  NPFFT  and  not  from  0  to  (NPFFT-1 ) .  The 
subroutine  PRCES  implements  the  six  AML  processors 
given  in  Table  4-1.  The  subroutine  PRCES  calls  on  the 
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subroutines  FFT  and  DPLOT  (already  discussed). 

Singleton's  subroutine  performs  a  mixed  radix  FFT; 
that  is,  the  number  of  data  points  do  not  need  to  be 
integer  powers  of  2  such  as  512,  1024,  2048  and  4096 
but  can  have  factors  of  2's,  3’s,  and  5's,  such  as 
1000,  1500,  2000  and  3000.  Numbers  which  can  be 
factored  into  2's,  3's,  and  5's  only  are  called  highly 
composite.  Given  the  FORTRAN  variable  NNN,  the  sub¬ 
routine  HICMP  finds  the  highly  composite  number  closest 
to  (but  greater  than  or  equal  to)  NNN.  The  output  of 
HICMP  is  NEWNNN.  For  some  applications,  the  program 
user  will  want  NEWNNN  to  be  twice  as  large  as  NNN; 
this  is  because  the  main  program  fills  the  data  arrays 
with  zero  from  NNN  +  1  to  NEWNNN.  Such  zero  filling 
is  (theoretically)  required  to  inhibit  the  effect  of 
circular  convolution;  in  practice,  though,  (with 
stochastic  data)  zero  filling  does  not  warrant  the  added 
(doubled)  computational  cost.  If  it  is  desired,  zero 
filling  can  simply  be  achieved  by  adding  one  line  to 
HICMP:  "NEWNNN  -  2*NEWNNN" . 

In  addition  to  calling  several  critical  subroutines , 
the  main  program  performs  computations  necessary  to 
estimate  the  spectral  characteristics  of  the  two  wave¬ 
forms  under  investigation.  The  computations  performed 
are  briefly  outlined  in  four  major  steps  in  appendix  A. 

When  the  two  input  waveforms  are  complex,  one  FFT  of 
each  waveform  segment  is  required  as  specified  in 
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Appendix  A.  However,  in  most  (though  not  all)  practical 
data  collection  facilities,  the  input  waveforms  are  real 
(not  complex).  When  x(t)  and  y(t)  are  real,  one  FFT  of 
the  complex  waveform  x(t)  +  Jy(t)  can  be  computed  and 
quickly  be  manipulated  to  form  the  FFT  of  x(t)  and  the 
FFT  of  y(t).  (See  p.  333-334  of  Oppenheim  and  Schafer 
(1975),  see  also  p.  271-293  of  Raoiner  and  Rader  (1972).) 
These  observations,  combined  with  (A-3)  give  rise  to 
the  FORTRAN  statements  used  to  estimate  the  spectral 
characteristics  of  x(t)  and  y(t).  The  application  of 
this  theory  reduces  the  computation  time  for  two  real 
waveforms  by  a  factor  of  two.  The  final  comment 
necessary  before  presenting  the  computer  listings  is  to 
describe  the  input  FORTRAN  variables.  NNN  is  the  number 
of  data  points  per  segment.  1SR  is  the  integer  sampling 
rate  (Hz).  NDSJP  is  the  number  of  disjoint  segments 
in  the  total  time  waveform.  SFX  and  SFY  are  scale 
factors  used  to  adjust  tne  (voltage)  level  of  the  input 
waveform  to  correct  for  frequency  independent  attenuations 
in  the  data  collection  and  digitizing  process.  (When  no 
correction  is  desired,  the  user  sets  SFX»SFY*1.0. ) 
when  the  user  desires  the  spectral  estimates  to  appear 
3  dB  higher,  he  sets  SFX-SFY-2 . 0. )  With  these  five 
sample  inputs,  the  input  time  data  are  processed.  The 
next  section  gives  a  complete  program  and  subroutine 
listing. 
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APPENDIX  D 


EXAMPLE  COMPUTER  RUN  FOR  SPECTRAL  AND 
TIME  DELAY  ESTIMATION 

Theoretical  equations  have  been  derived  in 
Chapter  3  for  ML  estimation  of  time  delay.  A  computer 
program  to  achieve  an  AML  estimate  of  delay  is  given 
in  Appendix  C.  Tho  purpose  of  this  chapter  is  to 
describe  four  example  cases  which  were  run  to  sub¬ 
stantiate  the  theory  and  validate  the  computer  program. 

One  computer  run  was  made  for  each  of  the  cases.  Only 
one  of  the  runs  will  be  explicitly  reported  here.  In 
all  of  the  four  cases  studied,  the  true  delay  was 
set  equal  to  zero  (without  loss  of  generality).  Further, 

the  signal  attenuation  was  set  equal  to  unity  so. that 
(3-1)  becomes 

xx(t)  »  s(t)+n1(t)  (D-la) 

x2(t)  -  s(t+D)*n2(t)  (D-lb) 

D  -  0  .  (D-lc) 

Our  desire  is  to  see  whether  (and  "bow  well")  we  can 
estimate  the  (assumed  unknown)  parameter  D,  given  a 
T  second  observation  of  x^(t)  and  x2(t).  The  variance 
of  the  ML  processor  (as  discussed  after  (3-34))  depends 
on  the  particular  signal  and  noise  spectral  characteristics 
(in  particular,  C12(f)).  Moreover,  the  variance  of  the 
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delay  estimate  can  only  be  empirically  determined  by 
resort  to  numerous  (expensive)  computer  runs.  Ve  have 
not  dons  that  here  (but  have  suggested  further  work  in 
this  area  (Chapter  6)).  Ve  have,  however,  made  four 
computer  runs  for  the  data  cases  synthesized  by 
Figure  D-l.  As  shown  in  the  figure,  the  signal  spectrum 
has  two  nonzero  frequency  bands.  The  bands  are  10  Hz 
wide  centered  at  5  and  50  Hz.  Each  of  the  five  filters 
represented  in  Figure  D-l  is  the  cascade  of  two  sections, 
each  with  a  48  dB/octave  roll  off.  The  noise  generators 
generate  white  noise.  Details  of  the  hardware  are  the 
same  as  described  on  pages  71-72  of  Carter  (1972a). 

The  actual  data  generation  required  less  hardware  than 
shown  in  Figure  D-l,  but  the  simulation  is  easier  to 
visualize  by  studying  Figure  D-l  and  is  closer  to  what 
would  be  done  in  a  real  time  simulation  of  the  type 
suggested  in  Chapter  6.  In  our  experiment ,•  we  adjust  the 
SNR  by  adjusting  the  gain  in  Figure  D-l. 

The  digital  outputs  of  the  data  synthesized  are 
stored  on  magnetic  tape  for  use  by  the  computer  program 
(Appendix  C).  Longer  observation  time  is  achieved  by 
reading  more  data  from  the  magnetic  tape.  In  the  four 
example  cases,  the  ML  processor  output  was  examined 
for  two  different  signal  levels  and  two  different 
averaging  times  T.  Expect  for  absolute  SNR  level  all 
four  example  cases  had  the  same  signal  and  the  same 
noise  spectral  densities.  As  expected,  when  the  SNR 
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wan  low,  more  averaging  tlae  was  required  to  extract 
a  "good"  delay  estimate;  this  behavior  is  predicted 
by  (3-34).  In  particular,  of  our  four  cases,  the  low 
SMB  sad  short  averaging  case  resulted  in  unusable  delay 
estimates.  The  reason  for  this  was  apparent  upon 
Inspecting  the  coherence  estimates  used  to  approximate 
the  true  coherence.  As  predicted  in  appendix  B  with 
short  averaging  times  (that  is,  small  N),  we  were  unable 
to  detect  a  low  coherent  source. 

This  happened  to  our  one  trial  at  low  SNR  and  short 
averaging;  however,  by  increasing  the  averaging  time, 
an  acceptable  time  delay  estimate  was  obtained.  Ve 
were  able  to  increase  the  averaging  time  (essentially 
without  bound)  since  the  example  cases  were  using 
laboratory  data. 

The  case  which  we  will  report  in  detail  is  the 
high-coherence,  short-averaging  case.  In  particular, 
the  gain  in  Figure  D-l  is  adjusted  so  that  C*0.6  in  the 
frequency  bands  with  signal  power  and  C*0  in  the  other 
bands.  The  characteristics  of  x^ft)  and  x2(t)  were 
estimated  from  8  seconds  of  data  with  16  Independent 
segments  (each  of  1/2  second  duration,  that  is,  2  Hz 
resolution).  FTTs  of  600  samples  (1/2  sec  times  1200 
samples/sec)  can  be  performed  using  the  fast  mixed 
radix  FFT  of  Singleton  (1969). 

The  characteristics  of  the  noise  generators  in 
Figure  D-l  were  essentially  identical.  Thus,  for  the 
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model  (D-l),  G  (f)«G  (f),Vf.  The  estimates  of 

xlxl  X2X2 

G  (f)  are  depicted  in  Figure  D-2.  The  estimates  of 
xlxl 

G„  (f)  were  extremely  similar  and  are  not  repeated. 

X2X2 

The  extent  to  which  x^Ct)  and  x2(t)  are  similar  is 
measured  by  the  MSC  estimate  in  Figure  D-3.  Since  the 
CC  and  delay  D  depend  upon  the  phase,  the  phase  estimates 
are  depicted  in  Figure  D-4.  The  slope  of  the  phase 
estimates  is  an  important  indicator  of  delay1  in  those 
frequency  bands  where  the  MSC  is  strong  (namely,  0-10  Hz 
and  45-55  Hz).  Using  the  algorithm  discussed  in 
Chapter  3  and  the  estimation  techniques  of  appendix  A 
implemented  in  appendix  C,  we  have  obtained  the  delay 
estimate  given  in  Figure  D-5.  From  Figure  D-5  we  see 
that  the  GCC  with  ML  weighting  peaks  very  close  to  the 
true  value  of  delay,  namely,  D«0.  A  blowup  of  Figure 
D-5  given  in  Figure  D-6  shows  that,  the  peak  is  within 
10  msec  of  the  true  value.  Clearly,  the  estimation 
technique  proposed  is  a  viable  method  for  estimating 
time  delay. 


^Dimensionally  the  slope  is  the  phase  angle  in 
radians  divided  by  the  frequency  in  radians  per  sec. 
Thus  the  slope  of  the  phase  is  measured  in  seconds. 
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ABSTRACT 


This  paper  investigated  methods  for  passive  estimation  of 
the  bearing  to  a  slowly  moving  acoustically  radiating  source. 
The  mathematics  for  the  solution  to  such  a  problem  is 
analogous  to  estimating  the  time  delay  (or  group  delay)  be¬ 
tween  two  time  series.  Since  the  estimation  of  time  delay  is 
intimately  related  to  the  coherence  between  two  time  series, 
a  summary  of  the  properties  of  coherence  is  presented. 
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The  term  coherence  has  several  different  meanings  and  indeed 

DEFINITIONS,  THE  ONE  WE  USE  HERE  IS  THE  MAGNITUDE  SQUARED  OF  THE 
COEFFICIENT  OF  COHERENCY  DEFINED  BY  WEINER  IN  1930.  In  PARTICULAR* 
FOR  OUR  PURPOSES  HERE*  WE  DEFINE  THE  COHERENCE  BETWEEN  TWO 
STATIONARY  RANDOM  PROCESSES  A  AND  8  AS  THE  MAGNITUDE  SQUARED  OF 
THE  CROSS  POWER  SPECTRUM  DIVIDED  BY  THE  PRODUCT  OF  THE  TWO  AUTO 
POWER  SPECTRA.  THE  COHERENCE  IS  A  FUNCTION  OF  FREQUENCY  AND  HAS 
THE  USEFUL  PROPERTY  THAT  IT  LIES  BETWEEN  ZERO  AND  UNITY.  It  IS* 

IN  EFFECT*  A  NORMALIZED  CROSS  SPECTRAL  DENSITY  THAT*  IN  SOME 
SENSE*  MEASURES  THE  EXTENT  TO  WHICH  TWO  RANDOM  PROCESSES  ARE 
SIMILAR.  FOR  EXAMPLE*  TWO  UNCORRELATED  RANDOM  PROCESSES  ARE  ALSO 
INCOHERENT;  THAT  IS*  THE  COHERENCE  IS  ZERO  BETWEEN  UNCORRELATED 

processes.  Further*  the  coherence  between  two  linearly  related 

PROCESSES  IS  UNITY, 
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The  physical  problem  that  motivates  this  research  is  a  desire 
TO  PASSIVELY  estimate  geographical  information  about  the  state 
OF  AN  ACOUSTIC  SOURCE.  In  THE  DEVELOPMENT  HERE  AN  ACOUSTIC  POINT 
SOURCE  RADIATES  SPHERICAL  WAVES,  RECEIVED,  FIRST,  AT  ONE  SENSOR 
AND  SOME  DELAYED  TIME  LATER,  AT  A  SECOND  SENSOR.  THE  SOURCE  IS 
ASSUMED  STATIONARY  FOR  THE  OBSERVATION  PERIOD  AND  THE  SENSOR 
SEPARATION  IS  ASSUMED  KNOWN.  EACH  RECEIVED  WAVEFORM  IS  OBSERVED 
IN  THE  PRESENCE  OF  UNCORRELATED  NOISE.  THE  PROBLEM  WE  ADDRESS  IS 
HOW  TO  ESTIMATE  THE  TRAVEL  TIME  OF  THE  WAVEFRONT  OR  TIME  DELAY 
FROM  ONE  SENSOR  TO  THE  NEXT. 

The  importance  of  obtaining  a  good  time  delay  estimate  is  that 

IT  CAN  BE  USED  TO  FIX  THE  SOURCE  LOCATION  ON  A  HYPERBOLIC  LOCUS 
OF  POINTS.  OF  COURSE,  IF  WE  HAVE  THREE  SENSORS  WE  CAN  ESTIMATE 
TWO  TIME  DELAYS  AND  THE  INTERSECTING  HYPERBOLIC  CURVES  CAN  BE 
USED  TO  ESTIMATE  SOURCE  POSITION. 
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GENERAL  CASE 


SPECIFIC  CASE 

X,Ot)  -  S(t)  +  n,(t) 
X4(t)  -  <*S  (t  +  0)  +  n 
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In  the  general  case  we  can  model  the  acoustic  source  propaga¬ 
tion  AND  NOISE  CORRUPTED  RECEPTION  AS  SHOWN  HERE.  In  PARTICULAR, 
WE  TREAT  THE  PATH  FROM  THE  SOURCE  TO  EACH  RECEIVER  AS  A  LINEAR 
TIME  INVARIANT  FILTER.  THE  RECEIVED  SIGNALS  X  ONE  AND  X  TWO 
CONSIST  OF  THE  FILTER  OUTPUTS  PLUS  NOISE. 

A  SPECIAL  CASE  OF  THIS  MODEL  IS  SHOWN  ON  THE  BOTTOM  OF  THE 

SLIDE.  The  first  received  waveform  consists  of  signal  plus  noise. 
The  second  received  waveform  consists  of  an  attenuated  and  delayed 

SIGNAL  IN  THE  PRESENCE  OF  NOISE.  THE  MATHEMATICAL  PROBLEM  WE 
ADDRESS  IS:  HOW  TO  BEST  ESTIMATE  THE  TIME  DELAY  OR  EQUIVALENTLY 
SOURCE  BEARING.  FURTHER  WE  ARE  CONCERNED  WITH  THE  ROLE  OF  COHER¬ 
ENCE  IN  THIS  PROCESS. 

For  analytic  purposes  we  treat  the  noise  as  stationary  and 

UNCORRELATED.  LATER  WE  MAKE  AN  IMPLICIT  ASSUMPTION  THAT  THE 
NOISE  IS  NORMAL  (GAUSSIAN). 
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For  the  general  model  we  can  show  that  the  received  signal-to- 

NOISE  RATIO  IS  A  FUNCTION  OF  ONLY  THE  COHERENCE  BETWEEN  THE  SOURCE 
AND  THE  RECEIVER.  INDEED/  RELATIVE  TO  THE  SENSOR  NOISE  POWER/ 

THE  AMOUNT  OF  POWER  RECEIVED  FROM  THE  SOURCE  AFTER  IT  HAS  BEEN 
ATTENUATED  BY  ACOUSTIC  TRANSMISSION  THROUGH  THE  OCEAN  MEDIUM  IS 
DESCRIBED  BY  THE  SOURCE-TO-SENSOR  COHERENCE  DIVIDED  BY  ONE  MINUS 
SOURCE-TO-SENSOR  COHERENCE.  MOREOVER/  THE  COHERENCE  BETWEEN 
THE  TWO  RECEIVED  WAVEFORMS  CANNQI  EXCEED  THE  COHERENCE  BETWEEN 
THE  SOURCE  AND  ANY  SENSOR j  THIS  IS  TRUE  WHEN  THE  OCEAN  MEDIUM 
IS  MODELED  AS  A  LINEAR  TIME  INVARIANT  FILTER. 

More  specifically/  the  coherence  between  the  two  received 

WAVEFORMS  IS  EQUAL  TO  THE  PRODUCT  OF  THE  COHERENCES  BETWEEN  THE 
SOURCE  AND  EACH  OF  THE  RECEIVED  WAVEFORMS. 
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Under  standard  assumptions,  namely,  that  the  two  received 

WAVEFORMS,  X  ONE  AND  X  TWO,  ARE  JOINTLY  STATIONARY,  NORMAL  (GAUSSIAN) 
RANDOM  PROCESSES  AND  THAT  THE  OBSERVATION  TIME  P  IS  LARGE,  THE 
MAXIMUM  LIKELIHOOD  ESTIMATE  OF  TIME  DELAY  CAN  BE  DERIVED.  THE 
MAXIMUM  LIKELIHOOD, OR  ML .ESTIMATE  OF  TIME  DELAY  CAN  BE  INSTRUMENTED 
INONE  OF  TWO  WAYS.  SHOWN  HERE  IS  ONE  REALIZATION.  THE  FIRST 
RECEIVED  WAVEFORM  IS  FILTERED  BY  H  ONE  TILDE,  AND  THE  SECOND 
RECEIVED  WAVEFORM  IS  FILTERED  BY  H  TWO  TlLDE  AND  DELAYED.  THE 

filters  must  have  identical  phase  responses.  The  filter  outputs 

ARE  SUMMED,  SQUARED,  AND  INTEGRATED  AS  SHOWN.  THE  HYPOTHESIZED 
VARIABLE  DELAY  THAT  MAXIMIZES  THIS  SYSTEM  OUTPUT  IS  THE  MAXIMUM 
LIKELIHOOD  ESTIMATE  OF  TIME  DELAY.  THE  SPECIFIC  FILTER  CHARAC¬ 
TERISTICS  DEPEND  ON  THE  SIGNAL  AND  NOISE  SPECTRA,  WHICH  MUST  BE 
KNOWN  OR  ESTIMATED. 
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Another  realization  for  the  maximum  likelihood  estimate  of 

TIME  DELAY  IS  A  SPECIAL  CASE  OF  THE  GENERALIZED  CROSSCORRELATION 
PROCESSOR.  IN  THIS  PROCESSOR  THE  FIRST  RECEIVED  WAVEFORM  IS  FIL” 
TERED  BY  H  ONE  AND  THE  SECOND  RECEIVED  WAVEFORM  IS  FILTERED  BY 
H  TWO/  DELAYED/  MULTIPLIED/  AND  INTEGRATED  AS  SHOWN  ON  THE  DIAGRAM 
AT  THE  TOP  OF  THE  SLIDE.  By  PROPER  CHOICE  OF  THE  GENERAL  WEIGHTING 
FUNCTION/  W/  WHICH  IS  THE  PRODUCT  OF  H  ONE  AND  H  TWO  CONJUGATE/ 

WE  CAN  ACHIEVE  THE  MAXIMUM  LIKELIHOOD  ESTIMATE  FOR  TIME  DELAY. 
HOWEVER/  WE  CAN  ALSO  ACHIEVE  A  GENERALIZED  CROSSCORRELATION 
FUNCTION/  R  OF  TAU/  BY  MULTIPLYING  THE  CROSS  SPECTRUM/  6/ 

BETWEEN  THE  TWO  RECEIVED  WAVEFORMS/  BY  THE  GENERAL  WEIGHTING/  W/ 

AND  COMPUTING  THE  FOURIER  TRANSFORM  AS  INDICATED  ON  THE  BOTTOM  OF 
THE  SLIDE. 
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If  we  estimated  the  generalized  crosscorrelation  function 

FOR  SIX  DIFFERENT  TRIALS*  THE  PEAK  OF  THE  FUNCTION  MIGHT  VARY 
AS  A  FUNCTION  OF  TRIAL.  WE  HAVE  ACTUALLY  IMPLEMENTED  THE  TECHNI¬ 
QUE  FOR  SEVERAL  EXAMPLE  CASES  ON  THE  UN1VAC  1108.  BASED  ON  OUR 
EXPERIMENTAL  RESULTS*  WE  SPECULATE  THAT  A  TYPICAL  GENERALIZED 
CROSSCORRELATION  FUNCTION  MIGHT  PEAK*  AS  INDICATED  IN  THE  HYPO¬ 
THETICAL  TRIALS  SKETCHED  HERE.  In  PARTICULAR*  THE  ABSCISSA  VALUE 
OF  THE  PEAK  LOCATION*  THAT  IS*  THE  ESTIMATE  OF  TIME  DELAY*  HAS  A 
CERTAIN  AMOUNT  OF  VARIATION.  NOTICE  ALSO  IN  TRIAL  NUMBER  5*  NEXT 
TO  THE  BOTTOM  PLOT*  THAT  A  NUMBER  OF  AMBIGUOUS  PEAKS  CAN  ARISE  IN 
ADDITION  TO  THE  LOCAL  VARIATION  OF  THE  TIME  DELAY  ESTIMATE.  THE 
AMBIGUITY  PROBLEM  IS  NOT  TREATED  IN  THIS  WORK.  THE  PROBLEM  OF 
COMPUTING  THE  VARIANCE  OF  THE  TIME  DELAY  ESTIMATE  IS  A  DIFFICULT 
ONE  IN  WHICH  ONE  IS  PUZZLED  HOW  TO  PROCEED.  HOWEVER*  IF  WE  COULD 
COUNT  THE  NUMBER  OF  PEAKS  THAT  OCCURRED  AT  EACH  OF  SEVERAL 
ABSCISSA  VALUES*  THEN  WE  COULD  PLOT  A  FREQUENCY  DISTRIBUTION  OF 
THE  PEAK  LOCATION.  FROM  THIS  DISTRIBUTION  WE  CAN  OBTAIN  THE 
VARIANCE  OF  THE  TIME  DELAY  ESTIMATE. 
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The  variance  of  the  time  delay  estimate  is  a  complicated 

FUNCTION  OF  SEVERAL  PARAMETERS.  It  DEPENDS  ON  THE  LENGTH  OF 
THE  OBSERVATION  TIME,  P,  THE  GENERAL  WEIGHTING  FUNCTION,  W,  THE 
AUTO-SPECTRAL  DENSITIES  OF  THE  TWO  RECEIVED  WAVEFORMS,  AND  THE 
MAGNITUDE  CROSS  SPECTRUM  BETWEEN  THE  TWO  RECEIVED  WAVEFORMS. 

It  also  depends  on  the  COHERENCE,  C,  defined  EARLIER  as  the 
MAGNITUDE  SQUARED  CROSS  SPECTRUM  DIVIDED  BY  THE  PRODUCT  OF  THE 
TWO  AUTO-SPECTRAL  DENSITIES.  RECALL  THE  COHERENCE  IS  GREATER 
THAN  OR  EQUAL  TO  ZERO  AND  IS  LESS  THAN  OR  EQUAL  TO  UNITY.  WHEN 
THE  OBSERVATION  TIME  IS  LARGE  OR  THE  COHERENCE  IS  NEAR  UNITY,  THE 
VARIANCE  IS  GENERALLY  QUITE  LOW  AND  YOU  CAN  DO  WELL  IN  SPITE  OF 
THE  WEIGHTING  SELECTED.  OF  COURSE,  AN  IMPORTANT  ROLE  TO  BE 
PLAYED  BY  THE  EXPRESSION  HERE  IS  TO  EVALUATE  HOW  DIFFERENT  PRO¬ 
CESSORS  COMPARE  WITH  ONE  ANOTHER.  ANOTHER  IMPORTANT  USE  OF 
THIS  EXPRESSION  IS  IF  ONE  KNOWS  THEORETICALLY  THE  BEST  WEIGHTING 
FUNCTION  TO  APPLY,  BUT  APPLIES  AN  INCORRECT  OR  SUBOPTIMUM  WEIGHT¬ 
ING,  THEN  THE  VARIANCE  OF  THE  SUBOPTIMUM  DELAY  ESTIMATOR  CAN  BE 
EVALUATED- 
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The  minimum  variance  for  any  time  delay  estimation  scheme 

CAN  BE  OBTAINED  FROM  THE  CRAMER  RaO  LOWER  BOUND.  As  SHOWN  HERE, 

IT  IS  A  FUNCTION  OF  ONLY  TWO  PARAMETERS:  THE  OBSERVATION  TIME  P 
AND  THE  COHERENCE  BETWEEN  THE  TWO  RECEIVED  WAVEFORMS.  As  P  IS 
INCREASED  THE  VARIANCE  DROPS j  FURTHER,  AS  THE  COHERENCE  C  TENDS 
TOWARD  UNITY  THE  TERM  C  OVER  ONE  MINUS  C  SQUARED  TENDS  TOWARDS 
INFINITY.  Thus,  as  the  coherence  or  C  tends  towards  UNITY,  THE 
VARIANCE  TENDS  TOWARDS  ZERO.  HOWEVER,  THE  COHERENCE  IS  NOT  UNDER 
OUR  CONTROL.  THE  FACTORS  WHICH  WE  CAN  CONTROL  ARE  THE  OBSERVATION 
TIME  P  AND  THE  WEIGHTING.  THE  MINIMUM  VARIANCE  IS  ACHIEVED  FOR 
THE  MAXIMUM  LIKELIHOOD  WEIGHTING  FUNCTION  GIVEN  BY  C  OVER  ONE 
MINUS  C  TIMES  THE  MAGNITUDE  CROSS  SPECTRUM. 
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The  maximum  likelihood  weighting  multiplies  the  estimated 

CROSS  SPECTRUM  TO  YIELD  A  SINGLE  FUNCTION  TO  BE  FOURIER  TRANS¬ 
FORMED.  In  GENERAL,  WHEN  the  TRUE  values  OF  COHERENCE  AND 
MAGNITUDE  CROSS  SPECTRUM  ARE  UNKNOWN,  THEY  MUST  BE  ESTIMATED. 

Estimates  are  indicated  by  hats, When  spectral  analysis  is  used 

TO  YIELD  ESTIMATES  IN  PLACE  OF  THE  TRUE  QUANTITIES,  THE  FUNCTION 

to  be  Fourier  transformed  is  indicated  on  this  slide.  The  cross 

SPECTRUM  OVER  THE  MAGNITUDE  CROSS  SPECTRUM  CAN  BE  THOUGHT  OF  AS 
E  TO  THE  MINUS  J  PHASE.  In  PARTICULAR,  NOTE  THAT  THE  WEIGHTING 
EMPHASIZES  THE  PHASE  OF  THE  ESTIMATED  CROSS  SPECTRUM  IN  THOSE 
FREQUENCY  BANDS  WHERE  THE  COHERENCE  IS  HIGH.  ONE  WOULD  EXPECT 
THE  ESTIMATED  PHASE  OF  THE  CROSS  SPECTRUM  TO  PLAY  AN  IMPORTANT 
ROLE  IN  TIME  DELAY  ESTIMATION,  SINCE  THE  SLOPE  OF  THE  PHASE  IS 
A  MEASURE  OF  THE  TIME  DELAY.  WE  CAN  SEE  THIS  BY  NOTING  THAT  THE 
PHASE  SLOPE  IS  MEASURED  IN  RADIANS,  DIVIDED  BY  RADIANS  PER  SECOND, 
OR  SECONDS.  OF  COURSE,  THE  PHASE  ESTIMATES  WILL  BE  NOISY  IN  THOSE 
FREQUENCY  BANDS  WHERE  THE  COHERENCE  IS  LOW  SO  WE  WILL  EMPHASIZE 
THE  PHASE  IN  THOSE  BANDS  WHERE  THE  COHERENCE  IS  HIGH. 
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SUMMARY 

•  ACOUSTIC  SOURCE 

•  TIME  DELAY  MODEL 

•  DERIVED  ML  TIME  DELAY  ESTIMATE 

•  DERIVED  CRAMER  RAO  LOWER  ROUND 

•  DERIVED  THE  VARIANCE  FOR  ANY  QCC 

•  SHOWN  ML  ESTIMATE  IS  MINIMUM  VAR 

•  IMPLEMENTED  RESULTS 

•  APPLICATIONS  TO  ESTIMATING  SOURCE  POSITION 
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In  summary,  the  physical  problem  motivating  this  research  is 
A  DESIRE  TO  ESTIMATE  POSITIONAL  INFORMATION  ABOUT  AN  ACOUSTIC 
SOURCE.  We  HAVE  PROPOSED  A  TIME  DELAY  MODEL  AND  DERIVED  THE 
MAXIMUM  LIKELIHOOD  ESTIMATE  FOR  TIME  DELAY.  ADDITIONALLY  WE  HAVE 
DERIVED  THE  CrAmIr  RaO  LOWER  BOUND  ON  THE  VARIANCE  OF  THE  TIME 
DELAY  ESTIMATE.  SUBSEQUENTLY  WE  HAVE  DERIVED  AN  EXPRESSION  FOR 
THE  VARIANCE  OF  THE  TIME  DELAY  ESTIMATE  FOR  ANY  GENERALIZED  CROSS¬ 
CORRELATION  PROCESSOR.  We  HAVE  SHOWN  THAT  THE  MAXIMUM  LIKELIHOOD 
ESTIMATE  OF  TIME  DELAY  ACHIEVES  THE  CRAMER  RaO  LOWER  BOUND  AND  IS 
THEREFORE  MINIMUM  VARIANCE;  AS  SUCH  THE  PROPOSED  TECHNIQUE  IS  THE 
BEST  PROCESSING  THAT  CAN  BE  DONE  TO  ESTIMATE  TIME  DELAY  OR.  EQUIV¬ 
ALENTLY,  TO  ESTIMATE  THE  HYPERBOLIC  LOCUS  OF  POINTS  ON  WHICH  THE 
ACOUSTIC  SOURCE  IS  LOCATED.  THERE  IS  NO  BETTER  TECHNIQUE.  We 
HAVE  IMPLEMENTED  THE  RESULTS  IN  AN  APPROXIMATE  METHOD  BY  SUB¬ 
STITUTING  ESTIMATED  MAXIMUM  LIKELIHOOD  WEIGHTING  IN  PLACE  OF 
TRUE  WEIGHTING  AND  FOUND  THAT  THE  TECHNIQUE  WORKS  ON  A  LARGE 
SCALE  DIGITAL  COMPUTER.  Of  COURSE,  THE  ABILITY  TO  LOCATE  A 
SOURCE  ON  A  HYPERBOLIC  LOCUS  OF  POINTS  SUGGESTS  THAT,  WITH  THREE 
SENSORS,  INTERSECTING  HYPERBOLIC  CURVES  CAN  BE  USED  TO  ESTIMATE 
SOURCE  POSITION. 


i 
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Additional  references  not  given  in  the  conference  proceedings 

INCLUDE  MY  RECENTLY  COMPETED  Ph.D.  THESIS  AND  AN  ARTICLE  ON  GEN¬ 
ERALIZED  CORRELATION  PROCESSING  THAT  HAS  JUST  APPEARED  IN  THE 
August  IEEE  transactions  on  acoustics  speech  amp  signal  processing. 
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Proceedings  Reprint 


THE  ROLE  OF  COHERENCE  IN  TIME  OELAY  ESTIMATION 


6.  Clifford  Carter 

Naval  Underwater  Systems  Center 
New  London,  Connecticut  06320  U.S.A. 


ABSTRACT.  This  paper  Investigates  methods  for  passive  estimation 
of  the  bearing  to  a  slowly  moving  acoustically  radiating  source. 
The  mathematics  for  the  solution  to  such  a  problem  Is  analogous 
to  estimating  the  time  delay  (or  group  delay)  between  two  time 
series.  Since  the  estimation  of  time  delay  Is  Intimately  related 
to  the  coherence  between  two  time  series,  a  summary  of  the  pro¬ 
perties  of  coherence  Is  presented. 

The  maximum  likelihood  (ML)  estimate  of  time  delay  (under 
jointly  stationary  Gaussian  assumptions)  Is  presented.  The 
explicit  dependence  of  time  delay  estimates  on  coherence  Is  evi¬ 
dent  In  the  estimator  realization  In  which  the  two  time  series 
are  prefiltered  (to  accentuate  frequency  bands  according  to  the 
strength  of  the  coherence)  and  subsequently  crosscorrelated.  The 
hypothesized  delay  at  which  the  generalized  crosscorrelation  (GCC) 
function  peaks  is  the  time  delay  estimate.  The  variance  of  the 
time  delay  estimate  is  presented  and  discussed. 

INTRODUCTION.  An  acoustic  source  whose  signal,  s(t).  Is  trans¬ 
mitted  through  the  ocean  medium  and  received  In  the  presence  of 
additive  noise  can  be  characterized  by 

Xj(t)  •  s^t)  ♦  n^t)  ,1-1,2  (1) 

For  the  main  purposes  of  this  paper  s,(t)-s(t),  s2(t)»as(t+0)  and 
we  desire  to  present  an  ML  estimator  ‘for  the  time  delay  0.  The 
delay  parameter  can  be  used.  In  a  nondlsperslve  medium  with  known 
speed  of  transmission,  to  estimate  the  bearing  to  an  acoustic 
source  (relative  to  the  sensor  baseline)  or,  more  generally,  to 
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estimate  a  hyperbolic  "line"  of  position.  Since  the  final  result 
depends  heavily  on  the  coherence  between  xj  and  xg,  we  precede 
the  development  with  a  concise  review  of  the  properties  of  the 
coherence  function  and  of  results  that  bear  directly  on  the  esti¬ 
mation  of  time  delay. 

THEORY  OF  COHERENCE.  For  any  two  jointly  stationary  random  pro¬ 
cesses  xj  and  %2*  the  coefficient  of  coherency  or  the  complex 
coherence  has  been  defined  by  Weiner  (1930)  as  the  ratio 
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xl*2 
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where  G„  „  (f)  Is  the  cross  power  spectral  density  function  be- 


x,x 


12 

tween  xj  and  xg,  and  Gx  x 


(f),  1-1,2  are  the  auto  power  spectral 


ri 

density  functions  at  frequency,  f. 

The  magnitude-squared  coherence  (MSC)  or  simply  the  coherence 
Is  defined  by  (see,  for  example.  Carter,  Knapp  and  Nuttall  (1973)) 


Cx  x  (f> 
xlx2 


wwf 


s_  .  (f)  8  (f) 


(2) 


A  useful  property  of  the  MSC  Is 


0  <  C 
-  Xlx2 


(f)  <  l 


provided  the  autospectra  are  positive  (in  particular  non  zero). 

In  order  to  attach  some  physical  significance  to  what  the 
coherence  measures,  consider  that  the  ocean  medium  operators  Mi 
and  M2  are  linear  time-invariant  filters.  Thus  si(t)  and  S2(tJ 
In  equation  (1)  are  the  respective  outputs  of  filters  Mj(f)  and 
M2(f)  when  excited  by  source  s(t).  When  the  noise,  n<f(t),  Is  un 
correlated  with  the  signal,  s(t),  at  the  1-th  sensor,  the  ratio 
of  the  recel ved  signal  power  at  the  output  of  the  ocean  channel 
to  the  corruptive  noise  power  depends  on  the  coherence  between 
the  source  and  the  sensor.  Specifically,  from  Carter,  Knapp, 
and  Nuttall  (1973) 
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(3) 


That  Is,  the  received  signal-to-nolse  ratio  (SNR)  at  the  1-th sen¬ 
sor  depends  on  the  coherence  between  the  source  and  the  received 
waveform.  This  result  has  oeen  expressed  by  Carter  and  Knapp 
(1976)  wore  compactly  as 


<f)  *  csx  (f)  C.._<f) 


sx. 


(4) 


These  results  apply  only  to  the  case  where  the  medium  can  be 
accurately  modeled  by  linear  time- Invariant  filters  corrupted  by 
uncorrelated  additive  noise. 

RESULTS.  For  the  purpose  of  obtaining  an  ML  estimate  of  delay, 
certain  assumptions  are  required.  In  particular,  for  a  signal 
emanating  from  a  nearfield  source  and  monitored  In  the  presence  of 
noise  at  two  spatially  separated  sensors  we  require  In  equation  (1) 
that  S}(t)  ■  s(t)  and  s2(t)  •  as(t+D).  Further,  we  require  that  a 
Is  real  and  s(t),  nj(t),  and  n2(t)  are  real,  jointly  stationary, 
Gaussian  random  processes.  Source  s(t)  and  noises,  nj(t)  andn2(t) 
are  assumed  to  be  mutually  uncorrelated. 


An  estimated  value  of  0  Is  the  hypothesized  value  t  that  maxi¬ 
mizes  the  generalized  crosscorrelatlon  (GCC)  function  defined  by 


(f)W(f)ejZ7rfJf 


(5) 


For  xi(t)  and  x2(t)  real,  the  ML  estimator  requires  a  particular 
weighting. 


M(f)  «  Hx(f)H2*(f)  «• 


Cx  x  (,) 

XjXj 


lG**(,)l  D  -  c«i«2(f)] 

A  complete  derivation  Is  given  by  Carter  (1976). 


(6) 


Note  from  equation  (6)  that  for  the  ML  estimate  of  delay  that 
W(f)  Is  real.  The  ML  estimator  Is  virtually  equivalent  to  one 
proposed  by  Hannan  and  Thomson  (1973).  The  ML  estimator  can  be 
achieved  by  shaping  Xj(t)  with  filter  H,(f)  and  x2(t)  with  filter 
H2(f)  crosscorrelatlng  the  filter  outputs,  and  observing  what  hypo- 
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theslzed  value  of  delay  achieves  a  maximum. 

The  estimator  can  also  be  achieved  by  other  methods.  For 
example,  Hahn  (1975),  Carter  and  Knapp  (1976)  and  Carter  (1976) 
present  a  method  of  filtering  and  sural ng  the  outputs,  squaring 
end  averaging  In  order  to  estimate  the  delay  0.  The  processor 
could  also  be  realized  as  a  number  of  "best*  estimates  of  0  for  a 
variety  of  frequencies.  The  ML  estimate  Is  then  achieved  by  per¬ 
forming  a  weighted  average  across  frequency.  For  example.  Clay, 
Hlnlch  and  Shaman  (1973)  develop  ML  estimates  of  bearing  (analo¬ 
gous  to  delay)  for  each  of  a  number  of  different  frequencies.  To 
obtain  a  single  estimate  of  source  bearing,  these  Individual  esti¬ 
mates  should  then  be  combined  with  weighting  dependent  upon  the 
•particular  underlying  signal  and  noise  characteristics. 

The  role  of  coherence  In  the  weighting  used  for  ML  estimation 
of  0  Is  specified  In  .equation  (6).  Note  that  those  values  of  co¬ 
herence  near  unity  are  most  Important;  conversely,  In  those  fre¬ 
quency  bands  where  there  Is  no  source  signal  power  (hence,  where 
the  received  waveforms  are  Incoherent),  the  delay  estimate,  as 
would  be  expected,  receives  no  weight.  The  ML  estimator  Is  actu¬ 
ally  a  function  of  more  fundamental  spectral  measurements  than 
those  specified  In  equation  (6).  However,  expressing  the  pro¬ 
cessor  In  more  fundamental  but  unnormal Ized  quantities  can  make 
Interpretation  more  difficult,  though  equally  correct. 

The  ML  weighting  agrees  with  MacDonald  and  Schulthelss 
(1969),  and  Hahn  (1975)  under  specific  conditions  (Including  when 
there  are  two  sensors  and  no  attenuation). 

VARIANCE  OF  GENERAL  TIME  DELAY  ESTIMATORS.  The  variance  of  the 
time  delay  estimate  In  the  neighborhood  of  the  true  delay  for 
general  weighting  function  W(f)  Is  given  by 


V.rE-ol-  il  '  C“<f)]df  <7) 

where  P  Is  the  observation  period  (In  seconds).  From  equations 
(6)  and  (7),  the  variance  of  the  ML  processor  Is 


Var1 


Ml 


H1 


2P  f 
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1  -  c12(f) 


df 


(8) 
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The  W.  processor  achieves  the  Cramer-Rao  lower  bound  (see  Carter 
(1976)).  Therefore,  the  processor  achieves  a  variance  less 
than  or  equal  to  that  provided  by  other  correlation  processors. 

These  results  for  variance  can  be  related  to  MacDonald  and 
Schulthelss  (1969)  as  follows.  Define  the  bearing  to  an  acoustic 
source,  as  In  Nuttall,  Carter  and  Montavon  (1974) 

4  ■  ere  cos  ^  (9) 

where  £  Is  the  speed  of  sound  In  the  nondlsperslve  medium  and  d 
Is  the  sensor  separation.  Consider  the  case  where  the  estimated 
D  equals  the  true  delay  plus  a  perturbation.  By  a  Taylor  series 
expanslon.lt  follows  for  the  bearing  error  defined  by  the  differ¬ 
ence  between  the  true  bearing  and  the  estimated  bearing  that  the 
standard  deviation  of  the  bearing  error  Is  given  by  (Carter 
(1976)): 


[»»r  (♦-♦)]''•  J7S7  [»••“  <  5 -  D  )]  *  (10) 


The  term  d  sin  4  can  be  viewed  as  the  effective  array  length 
(sensor  separation)  physically  steered  at  the  source. 

The  combining  of  equations  (8)  and  (10) 
suggests  that,  in  order  to  reduce  the  variance  of  the  bearing 
estimate,  the  observation  period  and  the  sensor  separation  should 
be  made  as  large  as  possible.  This  agrees  with  one's  Intuition 
and  the  results  of  MacDonald  and  Schulthelss  (1969).  Further, 
the  fact  that  equation  (10)  depends  on  the  effective  array  length 
physically  steered  toward  the  source  suggests  the  desirability 
of  sensor  mobility  to  maximize  sin  4  when  d  Is  limited. 
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ABSTRACT 

The  variance  of  the  phase  estimate  of  the  cross  spectrum 
and  coherence  is  numerically  evaluated  for  values  of  the  true 
magnitude-squared  coherence,  S,  equal  to  0(.1).9  and  .99,  and 
for  the  number  of  independent  averages,  n.  equal  to  1(1)500.  It 
is  found  that  the  approximation  (1  -  SV(SK),  where  K  *  2n  for 
independent  averages,  is  a  good  one  for  all  S  and  for  K  >  10, 
although  the  approximation  is  generally  optimistic.  A  useful 
recursion  formula  for  the  probability  density  function  of  the 
phase  estimate  is  also  derived.  The  danger  of  employing  a 
Gaussian  approximation  is  demonstrated  dramatically  in  a 
numerical  example.  An  extension  of  the  equivalent  degrees  of 
freedom  to  complex  averages  is  made  and  suggested  for  use 
in  cross  spectral  estimation. 
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INTRODUCTION 


Approximate  expressions  for  the  variance  of  the  phase  estimate  of 
the  cross  spectrum  and  coherence  are  given  In  Ref.  1,  pp.  378-9,  and 
Ref.  2,  eq.  (25B).  However,  both  of  these  results  are  limited  In  ap¬ 
plicability  to  the  region  where  the  variance  Is  small  In  comparison 
with  unity.  Here  we  will  use  the  results  of  Ref.  3  and  evaluate 
numerically  the  exact  variance  of  the  phase  estimate  for  the  complete 
range  of  possibilities.  As  a  by-product,  we  will  be  able  to  tell  ex¬ 
actly  when  the  approximation  is  accurate. 

The  method  of  processing  used  to  obtain  the  estimates  it  given 
In  Refs.  1-3,  and  will  not  be  elaborated  on  hare,  for  the  sake  of 
brevity.  The  reader  Is  referred  to  these  references  for  additional 
details  and  assumptions. 
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RECURSION  EQUATION  FOR 
PROBABILITY  OENSITY  FUNCTION 


We  let  ¥  denote  the  true  magnitude  coherence,  and  ^  denote  the 
true  argument  (phase)  of  the  cross  spectrum  or  coherence,  of  t wo  sta¬ 
tionary  random  processes.  Then  If  ^  Is  the  estimate  of  the  phase,  the 
probability  density  function  of  based  on  an  average  of  n  statistically 
Independent  pairs  of  samples.  Is  given  In  Ref.  3,  eqs.  4.100  and  4.102  by 


where  we  have  added  sub-n  to  the  probability  density  function  for  dis 
ti notion,  and  where 


2  =:  («)•  t«). 


(S) 

0) 


In  order  to  develop  a  useful  recursion  for  (1),  let 

Then  for  nil  (Ref.  4,  eq.  2.510,  line  5), 

T.M  « 

Therefore  . 

1i(orcsm^  *  *)  “  2(l- J  ^ 


W 

(«5 

(6) 


I 

f 


I 

I 
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and  (1)  becomes 

r  -£t" 


But  since  (for  nfe?) 


tee  can  solve  for  T  ()  and  substitute  It  In  to  obtain  the  re¬ 
cursion:  t  r  *  “I 


To  start  this  recursion,  we  need: 


which  Is  given  by 


Equations  (9)  and  (11)  constitute  a  useful  recursion  procedure  for  eval¬ 
uating  high-order  probability  density  functions  of  the  phase  estimate. 
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VARIANCE  OF  THE  PHASE  ESTIMATE 


the 

(1) 


For  4l«0  (or  for  a  redefined  origin  of  phase  relative  to  ), 
man  of  4  1*  zero,  since  probability  density  function  In 

1$  obviously  even  about  zero.  Therefore  the  variance  or  4  is 

A  closed  form  expression  for  (12)  does  not  appear  possible.  Hence, 
we  use  numerical  Integration  to  evaluate  (12).  Let  be  the  Incre¬ 

ment  In  approximating  (12).  Then 


0*) 


2a 


=  k1  j>.  (k*)] , 


(13) 


04) 


where  Is  a  general  set  of  Integration  weights  In  (13),  and  where 

(14)  applies  for  Simpson  mights.  A  program  for  the  evaluation  and 
plotting  of  (14)  Is  presented  In  Appendix  A.  The  results  are  given  in 
Figure  1*  where  we  have  defined 

^  r  cotarewae,  (,s) 

K  *  2v»  -  valent  degrees  «f  f return*.  60 

Straight  lines  have  been  drawn  between  the  integer  valuesof 

for  ease  of  Interpretation.  The  reason  for  definition  (16)  is  considered 

In  the  next  section. 

An  approximation  for  the  variance,  is  given  by 


4 
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as  mentioned  In  the  Introduction;  this  result  Is  claimed  accurate  If 
SKsfrl.  The  asymptote  (17)  for  large  K  Is  shown  as  dashed  lines  In 
Figure  1  for  S*.l,  .5,  .9.  and  .99.  and  shows  quantitatively  when  (17) 
can  be  used.  In  particular.  If  SK>20»  the  error  In  using  (17)  appears 
to  be  only  a  few  per  cent. 


USE  OF  RESULTS  FOR  OVERLAPPED  PROCESSING 


In  References  2  and  5,  spectral  estimation  via  overlapped  FFT 
processing  of  windowed  data  was  considered,  and  an  equivalent  degrees 
of  freedom  was  defined  as: 


where  m  is  the  total  mmber  of  (overlapped)  pieces  entering  the  spectral 
estimate,  w$  Is  the  data  window,  Is  the  autocorrelation  of  win¬ 

dow  w  ,  and  s  Is  the  shift  between  adjacent  overlapping  windows.  An  In¬ 
formative  Interpretation  of  (18)  for  complex  averages  Is  presented  In 
Appendix  B. 

When  shift  s  Is  greater  than  the  length  of  window  w,  the  auto¬ 
correlation  t»(k^)  Is  zero  except  for  k*o.  In  which  case  (18)  yields 
K*2*  ;  this  Is  the  case  treated  In  Ref.  1  and  plotted  above  In  Figure  1. 
When  shift  t  Is  less  than  the  length  of  window  w  ,  K  decreases  below  the 
value  2«i  ,  and  In  fact  as  a-»0,  K-»2.  Thus  K  Is  bounded  by  2  and  2h  , 
depending  on  the  amount  of  overlap  of  the  Individual  windows. 

The  exact  derivation  of  the  variance  of  the  phase  estimate  of  the 
cross  spectrum  and  coherence  for  overlapped  processing  appears  to  be 
very  difficult.  However,  an  approximation  Is  available  via  use  of  Figure  1, 
If  K  Is  computed  via  (18),  for  the  particular  window  and  overlap  of  In¬ 
terest;  the  justification  for  this  approach  Is  presented  In  Appendix  B. 

The  accuracy  of  this  approximation  Is  unknown. 
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COMMENT 


An  alternative  technique  for  approximating  the  variance  of  the 
phase  estimate,  which  utilizes  a  Gaussian  assumption.  Is  presented 
In  Appendix  C.  It  Is  found  to  grossly  overestimate  the  variance  In 
some  cases,  and  points  out  the  danger  of  using  the  Gaussian  assumption 
without  care. 
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APPENDIX  A 

PROGRAM  FOR  EVALUATION  AND  PLOT  OF  (14) 


PAMAWETiiH  NT=500  6  IfeKDNT 

DOUfiLE  PRECISION  a<NT>»P<NT> #K2»Pl#P2»02PI* 

SOEL .  T'JcL3 » vi  \i  iS  j  »  DELTA  »G2PI » DELTAS  #  GAMMA ,  PH  I ,  KS  <» 
DIMENSION  X{NT)  #S(*iT)  »Z(200) 

JC.\P=512 

KlsJCAP-l 

K2sJCAP**2 

PXsi.  m5*2S533d974324jC 

P2=.5*PI 

02PI=.5/pi 

DcL=PI/JCAP 

TUEl3=2  .  *DtL-«*i/3 .00 

CALL  MOGESl(Z’C) 

call  subjEw  ( z  *  c  •  > « » 3 » » 1 » ) 

CALL  OUJC r G  ( Z» 12C0 . » 335 . * 290C . » 2735 . ) 

CAwL  ScTSMG (Z»3Q  »2. ) 

DO  11  1=0 #3 

CALL  LlNESG(Z#C*FLOAT(I> »-3.) 

11  CAcl  LlMES(j(Z#  1  »FlOAT ( i )  » 1  • ) 

DO  12  I=-3, i 

CmlL  Llii£3si(Z»0*0.  *FLOAT(  I) ) 

12  CALL  LlKEiG(Z »1#3. *FL0AT(I) ) 

00  6  tl=l, NT 

6  X(N)SL0G1 0(2.  ■*(••) 

00  1  IGamSGsQ  1 1C 
GAMSGs  .  IDO*  IGAK.SQ 
IF(IGANiSO.EQ.IO)  GAcSG=.?9O0 
OELTAsI.-GmMSQ 
D2PI=0ElTA*02P: 

CELT  A2= ,  5*0'ILT  A 
GAMMAsSGR  r  t  GAiMSG ) 

PHI=PI 
CAwL  PKECUH 
DO  2  M=l ,MT 

2  G(H)=K2*P(U) 

DC  3  KSlrKl 

KSO=K**2*(3.-(-l» ) «*K> 

PHI=K*DEL 

CALL  PRECUR 
00  4  N=1 , NT 

H  Q(N)=0(N) +P(N) »KSG 

3  CONTINUE 
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00  5  NSL'NJ 
5  SlN)sO(M) *T0fcL3 

PRINT  8a,  6A*S0 
86  FORMAT t/C20. 2) 

NT9SNT-9 

00  7  I=1,NT9»10 

7  PR  it  iT  G ,  Sill  *SU*1>  ,S(I*2>  .SCX+3)  #S(W«n  * 

$S( 1+5)  »S(U6>  *S ( 1+7)  ,S(J+8>  .Sd+9) 

8  FORMAT (2X *10610.8) 

CO  9  lsi,NT 

9  S(X)SL0G10<S<I> > 

CALL  LINSSG(Z*MT*X»S> 

1  CONTINUE 

CALL  P*G£G (X* 0 » 1 » 1 ) 

CALL  eXITG(Z) 

subroutine  precur 

DOUBLE  PRECISION  ZI»22,DZ,0ELTAN 
ZIs-GAMMA*COS(PMI) 

Z2sl./(l.-Zi+*2) 

P(l)=02PI*Z2*(l.-4l*SRRT(Z2)»tP2-ASIN(2n ) ) 

UZ=0£LTA2*Z2 

CELT ANsl, 

DO  1  Ns  2  *  NT 
0£LTANsOELTA«*OELTA 

1  P(N)S0Z/(N-1,)*<-02PI*DELTAN+(2.*N-1.>*P(W-1} ) 

RETURN 
END 
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APPENDIX  B 

EQUIVALENT  DEGREES  OF  FREEDOM  FOR  COMPLEX  AVERAGES 
General  Definition  of  Effective  Number  of  Independent  Samples 


Suppose  samples  are  n  complex,  statistically  Independent, 

Identically  distributed,  random  variables.  Define  complex  sum  (average) 

Then  Its  mean  Is 

¥  *  Yl T,  (8-2) 


and  Its  variance  Is 

s  hTwj1  .  H1  -  twT  «  *<  ,  ( 9-3 ) 


where  we  have  defined 


ef  « » w  - 1*1*  • 


Therefore  the  relative  stability  of  w  Is  (defined  as) 


fe- 


Now  when  £a^  are  correlated,  this  equation  can  be  taken  as  a  defi¬ 
nition  of  the  effective  number  of  statistically  Independent  terms  In  the 
sum(B-i)  ;  that  Is,  define  (for  Identically  distributed  variables) 


twf  „  15 1’ 

Cm1  *m 
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Equation  fe-  6)  Is  a  satisfactory  definition  provided  that  n,  s  n  ;  If 
not.  some  other  approach  Is  necessary,  because  should  never  be  larger 
than  «i . 


Effective  Number  for  Correlated  Samples 

Let  us  express  each  random  variable  In  terms  of  Its  mean  and  a 
zero-mean  component  according  to 

where 

x>o, 


Also  let  the  zero-mean  component  of  ^  satisfy 


<*,%*  '  A*  ({.•')> 


Substituting  these  results  In  (p-f),  we  obtain,  for  correlated  ran 
dom  variables, 


12 


Also 
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a, *  a»-3  -  x^;- (B~ n) 

with 

mT  - fo.-tXsf-V}  *  |*71\  &->*) 


In  order  to  evaluate  *  we  need  the  property  that 

c,t;c,c,  .  tTS  +  $T.  t  VS,  <Tc7  (p-'i) 

for  zero-mean  complex  Gaussian  random  variables  ;  this  property 
Is  derived  In  the  next  subsection.  Then  we  have 

=lxy*f  +  sfi  +  Vii  5T?  ,  0-JO) 


from  which  there  follows 

mT* 


Proof  of  Fourth-Order  Average  Property  (B-19) 
Let 


rj> + >  rj' 


5: 

K-0 


.H 

1  V 


where  are  zero-mean  real  Gaussian  random  variables.  Then 
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Utm*9 


*3»»  %»» 


jjln,u 


Kill  II  tn 

I  lo:.  V%,  ■*■ r*  r)»  ra  r4-  +  ^ 


s  C,  C;^C.1-  C. s  c*  *- r- C,  ^  CA 


(b-  2j) 


«o  special  properties  for  C.c  or  c(cj  need  be  assueed/for  this 
property  to  hold.  J  J 


Specialization  to  Cross-Spectral  Estimation 

In  order  to  utilize  (»-»*)  ,  we  need  to  evaluate  (p-n>  and  sub¬ 
stitute  It  In  (fr-i)  ,  so  as  to  determine  \p*\  .  Now  for  cross -spectral 
estimation.  \  and  ;}*  are  given  In  Ref. ‘2,  eq.  (3)  as  (suppressing 
f-dependence) 


(3-  *) 


\  =  J<ft  e^p(-t2-^Pf)  x  R-), 

\)„  «  Jeff  t^(-i  Mtr) 


TM  No.  771112 


Then  _ _ 

V?*  *  JJcH,  «&,  SnrKrO 

*  J  4u  (f -*}  Vi  (u^  (u)*  (j?  -  25) 

r jdu  G„  (f-u) |YlO*)f  ^(-1  2iru  {Xri)s) , 


where  s  Is  the  shift  of  adjacent  data  windows.  Now  if  -f  is  greater 
than  the  width  of  window  ,  and  if  the  window  width  is  narrower 
than  the  finest  detail  in  spectrum  C*  at  frequency  f  ,  we  have 

v7  « M) 


where  is  the  autocorrelation  of  data  window  w  .  In  a  similar 
fashion,  there  follows 

yj  *  4„  (( K-f)*)  .  (p-J1) 

And  if  -f  Is  larger  than  the  width  of  window  |W|*  .  It  may  be  shown 
that 

*  O  ;  (B-n) 

see  Ref.  2,  eq.  (A14)  et  seq.  Substituting  In  (e-ai)  , 

we  obtain 


77  *  G,W&SjW|7(Ms)|\  (J-21) 


and  therefore,  by  (&-1)  , 
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fl  * 

UK.)  I 

r 

<M°) 

(B-3o) 


Then  finally,  (B- la)  yields 


As  noted  under  ,  the  denominator  of  (0-30  certainly  satisfies 

the  requirement  of  being  greater  than  or  equal  to  1,  for  any  window  w  . 


Equivalent  Degrees  of  Freedom  for  Cross-Spectral  Estimation 

Equation  (0-3i)  gives  the  effective  number  of  Independent  terms 
In  the  sum  (fc-  is-)  ,  when  x*  and  are  given  by  (0-24.).  However, 
to  determine  the  equivalent  degrees  of  freedom,  we  expand  (p-is)  In 
terms  of  its  real  and  Imaginary  parts  as 

*1  -  *  X  (v  '  \iXy*r-  1  y»<) 

*■»  k-i  v  .  \ 

(p-») 

=  j2^|(vv  %) + '  y«r~ *>«•  y**)} 


Since  the  real  and  Imaginary  components  of  w  each  have  2n  terms  In 
their  averages.  It  Is  appropriate  to  define  the  equivalent  degrees  of 
freedom  of  random  variable  *1  as 


K  * 
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As  a  special  case, for  non-overlapping  windows,  K»2n,  which  Is 
the  result  used  In  the  main  text.  And  If  \  ,  w  *g£l**l*  * 

‘  ,  which  Is  the  standard  quantity  for  real  variables,  such 

as  encountered  In  auto-spectral  estimation.  The  result  \P-3>)  Is  the 
one  presented  In  Ref.  2,  eq.  (12).  (Equation  (9)  In  Ref.  2  should  be  de¬ 
fined  as  a  measure  of  stability,  and  not  as  the  equivalent  degrees  of 
freedom.) 
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APPENDIX  C 

APPROXIMATION  TO  VARIANCE  OF  PHASE  ESTIMATE 

FnomNef.  2,  eq.  22  (suppressing  f  dependence),  the  cross  spectrum 
estimate  k  can  be  expressed  as 

£»j  - 1 6»,l  +  « *  u+w  *  »■  ^ 

where  ?».  Is  the  true  phase,  and  Is  the  true  magnitude  of  the 

cross  spectral.  We  make  the  simplifying  assumption  (of  unknown  validity) 
that  &  and  b  are  Gaussian;  for  small  R  ,  this  could  yield  misleading 
conclusions.  Then  from  Ref.  2,  eqs.  (15)  and  (19), 

F  -  I »  o. 

8*»«W  »  ^“-(l+s). 

Vs «? » &g*4-sl 
&T" = o. 


where 

s  *ng\ 


Then  the  Gaussian  assumption  allows  us  to  express  the  probability  density 
function  of  u  and  v  In  (C-l)  as 


_j _ *J_  Islls£  .  _yl~) 

2-r^rk  fl  2ra‘  2«fJ, 


fc-+) 
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where 

to 


The  probability  density  function  of  Y  and  f  defined  In  (C-l)  Is 

then 


The  first-order  probability  density  function  of  t  Itself  Is  available 
from  (C-6)  by  Integrating  on  r  over  the  range  (O^o).  By  use  of  the 
result 


where 


£ (0  * 


we  find,  after  simplification  and  use  of  (C-2) , 

pto  *  tr  ^5-  (<5 ,  ftl  «■*,  M 


where 


{ 


S0--5) 

(MXv-S®.*) 


* 

& S^>. 
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The  two  fundamental  parameters  of  p(4)  are  K  and  S  • 

Since  fCf)  Is  even  In  4  »  •  The  variance  <?1s  numerically 

computed  via 

?-  4>y»,  (c-  a) 


and  Is  presented  In  Figure  C.l,  for  S*0(.l).9.  The  range  of  K  given 
Is  (1.  1000) i  however,  physical  significance  should  be  attached  only 
to  X*2($ee  (18)). 

Comparison  of  Figure  C.1  with  Figure  1  Immediately  reveals  that 
gross  overestimates  of  the  variance  can  result  from  use  of  (C-9)  -  (C-ll). 
For  example,  at  K*»0,  S*.1,  the  result  in  Figure  C.l  Is  ten  times  greater 
than  that  In  Figure  1.  The  results  are  In  better  agreement  for  small  S  , 
like  0.1.  On  the  other  hand,  for  5 *.11,  the  discrepancy  would  be  greater 
than  an  order  of  magnitude  for  a  wide  range  of  K.  For  large  K ,  the 
asymptote  (17)  Is  once  again  approached  In  Figure  C.l,  as  Indicated  by 
the  dashed  lines. 


t 
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ABSTRACT 


The  questions  regarding  a  positive  definite  spectral  estimate 
and  a  stable  correlation  recursion  (raised  in  NUSC  Technical 
Report  5501)  are  answered  in  the  affirmative  for  the  particular 
choice  of  weighting  recommended  in  the  above  reference.  A 
modified  and  updated  FORTRAN  program  for  multivariate 
spectral  analysis,  which  incorporates  calculation  of  the 
correlation  matricesvia  recursion,  and  the  aliased  correlation 
matrices  via  a  fast  Fourier  transform  (FFT),  are  included. 
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POSITIVE  DEFINITE  SPECTRAL  ESTIMATE  AND  STABLE 
CORRELATION  RECURSION  FOR  MULTIVARIATE  LINEAR 
PREDICTIVE  SPECTRAL  ANALYSIS 


INTRODUCTION 


A  generalization  of  burg's  algorithm  for  spectral  analysis  to  the 
Multivariate  case  was  the  subject  of  an  earlier  report.  All  the  desir¬ 
able  properties  of  the  univariate  case  were  shown  to  hold  true,  except 
that  it  was  not  proven  that  the  residual  Matrix  was  positive  definite, 
nor  that  the  correlation  recursion  was  stable.  Both  of  these  assump- 
tions  can  be  affirmed  by  drawing  on  the  results  in  Strand^  and  Burg. 3 

In  addition  to  affirming  these  two  assumptions ,  this  report  contains 
a  modified  and  updated  FORTRAN  program  that  supersedes  the  program  pre¬ 
viously  reported.1  The  modified  program  incorporates  some  more-explana¬ 
tory  format  statements,  the  calculation  of  the  (normalized)  correlation 
matrices  via  recursion,  and  the  aliased  (normalized)  correlation  matrices 
by  means  of  a  Fast  Fourier  Transform  (FFT) . 

This  report  is  a  sequel  to  an  earlier  report.1  In  order  to  elimi¬ 
nate  duplication,  that  report  is  referenced  for  background  information, 
a  list  of  symbols  used,  and  processing  technique.  We  shall  draw  freely 
on  that  report;  foT  example,  equation  (5)  of  the  earlier  report  will  be 
denoted  by  (5).1 


POSITIVE  DEFINITE  RESIDUAL  MATRIX 

The  (p-l)-th  order  forward  residual  matrix,  Up_i>  was  defined  in 
equation  (9S).1  We  wish  to  show  that  Up  is  positiw  definite;  the 
following  proof  is  based  on  referenced,  equations  (3.25-3.32). 

From  equation  (H-5),1  we  have,  using  the  Hermitian  property  of 
Up  and  Vp. 

t4-ur.-A?Vr,<\  ( 

and  from  equation  (137), 1  eliminating  b(P)h, 
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Notice  that  we  have  made  specific  use  of  the  inverse  weighting  in 
equation  (136). 1  Substituting  equation  (2)  into  equation  (1),  we  find 


therefore. 


^  (4) 

Taking  the  conjugate  transpose  of  both  sides  of  equation  (4)  and 
using  equations  (106)1  and  (114)1  yields 

(V  V£  Sf?  «  S*  -2A*  sf  +  <  S£  a;"  .  O 

Adding  equations  (4)  and  (S)  together  and  multiplying  by  -1,  there 
follows  % 

the  last  identity  was  derived  from  equation  (113). 1 


Define 


Then  equation  (6)  becomes  simply 

=-2Er.  m 

Now,  Ep  is  Hermitian  and  positive  definite*  (see  equation  (112)1); 
.1.0.  is  Hermitian  and  positive  definite  (see  equation  (114A)1). 

He  assume  that  U  j  is  positive  definite.  Then,  Up*x  is  positive 
definite,  and  so  U’^  s(W)  must  have  all  its  eigenvalues  positive 

•All  of  the  positive  definite  statements  should  be  qualified  with 
the  proviso  "with  probability  1." 


I  A*  *  * 


IV  v 

■J'X- 


■  t*.A  ». 
$$ 
**i*>v.: 

»f  -ft 


$• 

m 


p 

P 

•  sH  0 


-V  ,, 


i 

I 

■SjS 


(see  appendix  A).  As  a  result,  Mp.i  has  all  its  eigenvalues  negative, 
making  it  a  stable  matrix  (reference  4,  page  270).  Therefore,  the 
solution  of  equation  (8)  exists  and  is  unique  (reference  S,  equation  3). 

According  to  reference  4,  page  278,  problem  3,  there  exists  a  posi¬ 
tive  definite  solution  of  equation  (8)  for  Up.  Therefore,  there  is  a 
unique  positive  definite  solution  of  equation  (8)  for  Up.  Since 


M.-'R. 


CM 


(from  equations  (95) 1  and  (82)1)  is  positive  definite,  the  assumption 
above,  that  Up. j  is  positive  definite^  can  be  justified  by  induction. 

In  sumary,  the  residual  matrix  Up,  calculated  by  means  of  equa¬ 
tion  (105)1  or  (181), 1  is  positive  definite.  The  quantity  Vp  is  also 
positive  definite;  the  equation  analogous  to  equation  (6)  is 

(-£vr3v>tf-'£sp)-n.  O' 

and  all  the  comments  above  apply  directly.  It  is  worth  repeating  that 
the  positive  definite  conclusion  on  UL  and  Vp  holds  for  the  specific 
inverse  weighting  indicated  in  equation  (1365 1 ;  whether  it  also  holds 
for  other  weightings  is  unknown. 


STABLE  CORRELATION  RECURSION 


The  correlation  recursion  is  given  in  equation  (164)1  acc0rding  to 


<  -  -R.tr 


N  •<  0, 


(11) 


where  superscript  p  has  been  added  to  the  correlation  matrices  to  indi¬ 
cate  specifically  their  dependence  on  the  p-th  order  predictive  filter; 
and  starting  values  have  been  defined,  as  in  equation  (D-3),l  namely. 
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«  K  ,  M  *  ?■  '12> 

The  latter  quantities  in  equation  (12)  are,  according  to  equation  (78A),* 
solutions  of 

^  Wip-  (13) 


Combining  equations  (11)  through  (13) ,  we  have 


1 1  m. 


(14) 


Mb  will  show  that  recursion  fll)  is  stable;  that  is,  we  will  show 
that  (the  eleaents  of)  natrix  does  not  tend  to  infinity  as  a  tends 
to  infinity,  with  p  fixed.  The  proof  is  an  extension  of  reference  3, 
section  III.C.2  (which  was  for  known  correlation),  to  fit  the  unknown 
correlation  case. 


We  have,  fron  equations  (82) 1  and  (SOA),*  respectively. 


i 


Jl 

*»«i 


A*  Rr*  |»r  pe  1;^)- 


(15) 


For  a  given  value  of  p,  define  the  (■  ♦  1)  *  (■  ♦  1)  block  Toeplitz 
aatrix 


(16) 


4 
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If  ■  <_  p,  the  entries  in  equation  (16)  are  according  to  equation 
(12),  where;'  if  a  >  p,  the  entries  are  those  generated  by  equation  (11). 
It  follows  immediately,  from  equations  (16)  and  (12),  that 

(17) 

The  s,t*th  block  ofl^P)  in  equation  (16)  is 

*•**"•  (U) 
Also,  define  a  (m  ♦  1)  *  (m  ♦  1)  block  matrix  , 


0  O  - 

r  o  - 
0  I  . 

o  o 


\ 

1  O 

...  o  x 


C19) 


where  we  require  m  >_  p  _>  1  for  this  definition.  Then,  using  the  nota 
tion  established  in*~equation  (18), 


{Cj]^  s  X  -  S„0  f or 


(20) 


where 


5 


T*  S729 


A*. 


At,  i«t*p 

0, 


Also, 


|0jH]  '  Sr ,,1'Sr.Af  4r  0*r,ssm. 

|| 

Then,  the  r,u-th  block  of  the  product  <^p)  *£p)  Q^p)  is 

,  j^-unt^r-LAf] 


.  *  S~  h.  arc.  -  S„  At' 

+  S„UWrH] 


-id  ■ -  s„  §»  -  £c  *rM  ♦  s*  «.  r 

.**  -  S*  -  S.|  C  Af+  Sn  J.  i-Z'fCAf. 


In  the  last  line,  above,  we  have  used  equation  (21)  to  simplify  equation  (23) 
At  this  point,  we  consider  four  subcases: 

(a)  for  1  <  r,  u  ^  equation  (23)  reduces  to  R^; 

(b)  for  r  «  0,  u  »  0,  equation  (23)  becomes 


..  *  , 
[(*,>>; 
tv*f  1 

It*.  ■»■*< 

te?1 

tv 


iw!: 

:v' 

I'SW 

iv 


j&c 
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Vi  ,» 

i!»«vc 


P.'lV 

TO* 
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<r-  ^*r«x*r’  > 


(24) 


but, by  use  of  equation  (14),  the  sub  on  s  in  the  last  ten  of  equation 
(24)  is  rXP^ 0  in  which  case  the  last  two  tens  of  equation  (24)  cancel, 
left 


We  are  left  with 


using  equations  (12)  and  (9S)1; 

(c)  for  r  ■  0,  1  <  u  <  ■,  equation  (23)  yields 

±*rc -o, 

using  equation  (14)2  and 

(d)  for  u  ■  0,  1  <  r  <  «,  equation  (23)  yields 


(25) 


(26) 


(27) 


since  this  is  the  conjugate  transpose  of  equation  (26).  Therefore,  we 
have 


or  cor 


V),  0  0 


o  c. 

0  Kf  Rj* 


o  *r 


•r: 


3L°r  1  _ 

0 

:  1  /C,r> 

•  I 

0| 


c; 


.  (28) 
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This  relation  holds  for  m  >.  p  ^  1 ,  as  noted  under  equation  (19)  (some 
relations  for  determinants”are”noted  in  appendix  B). 

Now,  let  tyfcl  be  arbitrary  nonzero  complex  M  *  1  column  matrices. 
Then,  using  equation  (28), 


=t:orv^:-v;K:: 


(29) 


We  recall  that  Up  is  positive  definite,  by  the  previous  section. 
Therefore,  if  is  positive  definite,  then  is  posi¬ 

tive  definite,  which,  in  tuxn,  implies  that  is  positive  definite. 
That  is,  for  ■  >  p  >  1, 

if  *e-l  is  P°sitive  definite,  then  is  positive  definite.  (30) 

In  particular,  letting  ■  ■  p,  we  see  that  if  is  positive  defi¬ 
nite,  then  *(P)  is  positive  definite,  tut  l?pP|  “  by  equation 

(17).  Hence,  if  is  positive  definite,  then  «Cp)  is  positive 

definite.  But  )  ■  R«  is  positive  definite  (see  equation  (IS)). 
Therefore,  we  conclude  by  induction  that 

Kpp^  is  positive  definite  for  all  p.  (31) 

This  statement  is  used  as  a  priori  information  in  Burg's  derivation  in 
the  known  correlation  case  (see  reference  3,  page  85). 

Now,  we  return  to  equation  (30)  with  this  information  and  can  draw 
the  conclusion  that  *00  is  positive  definite  for  all  m  >_  p.  Finally, 
using  equation  (17) ,  Ve  can  state 

is  positive  definite  for  all  m  and  p.  (32) 

For  fixed  Pt  since  is  positive  definite  for  all  m,  (the  ele¬ 
ments  of)  cannot  tend  to  infinity  as  m  tends  to  infinity,  since 
R$P)  ■  Rq  is  fixed.  Therefore,  recursion  (11)  is  stable.  This  implies 
(using  equation  (23) *)  that 

8 
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W(x-  t.-A?)  *  W  XU 


possesses  all  its  zeros  inside  the  unit  circle  in  the  z-plane;  that  is, 
predictive  error  filterH^P)  (z)  is  minimum  phase. 

The  proof  above  hinges  critically  on  the  positive  definiteness  of 
U  ,  which  was  demonstrated  in  the  previous  section.  In  particular,  this 
condition  is  eaployed  in  equation  (29)  to  guarantee  that  the  right-hand 
side  be  positive. 

A  word  of  caution  about  an  apparent  alternative  proof  is  worth 
Mentioning  here.  Having  shown  that  U.  is  positive  definite,  one  night 
be  tested  to  define  ft(p)  by  the  inverse  of  equation  (165), * 


-  *  lffcflV  Hftf T‘  ,  W  «*. 


according  to 


'R'Jf  *  l  #  «x^(i2e4e.4)  oil  *.  (3S) 

It  is  obvious  that  G^(f)  in  equation  (54)  is  positive  definite  for 
any  f;  and  it  is  now  easy  to  demonstrate  that  ATp)  is  positive  definite: 


JL 

*  (i2trf  U -*)d)  (x* (0 V* 

u 
JL 


since  G^(f)  is  positive  definite  for  any  f. 


9 


However,  the  problem  is  that  we  now  would  have  to  show  that  R^P) , 
as  generated  by  equation  (35),  satisfies  the  recurrence  (11).  An  example 
in  appendix  C  shows  that  for  an  unstable  sequence,  the  values  returned 
by  equation  (35)  are  not  the  same  sequence;  thus,  equation  (35)  should 
not  be  used  until  after  the  stability  of  {RjCP)}  has  been  ascertained. 


ALIASED  CORRELATIONS  VIA  FFT 


Based  upon  the  previous  results,  we  know  that  we  can  express 


and 

-L 

24 

'R  s  J  df  e^cefi  2irP»»fA^  Q'i'P);  **• 

2a 


Ne  have  dropped  the  superscript  p  above,  since  the  results  to  follow 
will  hold  for  any  correlation-spectrum  pair  satisfying  equations  (37) 
and  (38). 

If  spectrum  G(f)  is  calculated  only  at  a  discrete  set  of  N.  ♦  1 

(1  i  \  F 

-  2^,  (which  is  a  typical  practical  situation  for  plot¬ 
ting  purposes,  for  exanple),  a  discrete  approximation  is  afforded  to 
the  integral  in  equation  (38).  It  is,  for  trapezoidal  weights  (wfc)  , 

**r0  *“) "  kS 5  %.  ■  (39) 

That  is,  the  discrete  approximation  to  integral  (38)  yields  aliased  sam¬ 
ples  of  correlation  sequence  (R*)  at  separations  of  NF;  this  is  easily 
proven  by  substituting  equation  (37)  into  the  left-hand  side  of  equation 
(39)  and  interchanging  summations. 

The  aliased  sequence  {R,,,}  has  period  Np.  Therefore,  ^  is  a  good 
approximation  to  R*  for  |m|  <  Np/2  if  (rJ  is  sufficiently  small  for 
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|m|  >  Np/2.  (Generally,  Np  »  Pgggj  in  the  linear  predictive  approach, 
and  this  is  true.)  The  reason  for  considering  this  approach  to  the 
approximate  evaluation  of  correlation  sequence  O^}  follows. 

The  left-hand  side  of  equation  (39)  can  be  accomplished  by  means  of 
an  Np-point  FFT  (one  FFT  for  each  element  of  the  M  *  M  matrices  involved) 

For  trapezoidal  weights,  using  the  fact  that  cf-  ■  G  (i_J,  equation 


(39)  is  expressible  as 


r  -i 

= ^yS^r(i2irk’/N'')S; * 


where  we  have  defined 


Si  •  S-^r) , IW  *  tF  • 


Letting  n  ■  Np  ♦  a  in  the  first  sum  of  equation  (40),  and  n 
the  second  sum,  we  obtain 


X  -  -21  **f  (‘  2-Jrwwt/ Np)  Y„  , 

n  n«o 


where  M  *  M  matrix 


r  a.,  1 

But  equation  (42)  is  recognized  as  an  Np-point  FFT  of  the  matrices 


Wjy: 

'*4-. 


Wi'Vll' 
rKi  ’  £  8 


kj 


n 
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nrmRnnn 


nrnnn nra*ci 


£»,  »  ^  » ••*/  ^-i  ' 


(44) 


thus,  we  obtain  fto,  Ri,  ....  R^_|  by  means  of  fiis  Np-point  FFT,  one 

FFT  for  each  element  of  the  M  *  M  matrices.  (The  quantities  {ft,,}  for 
|m|  <  Np/2  are  available  by  use  of  the  periodic  nature  of  sequence 
(ffe}.)  This  use  of  an  N.-point  FFT  to  obtain  (good)  estimates  of 
correlation  sequence  (R.  }  circumvents  the  use  of  recursion  (11),  which 
would  yield  the  exact  correlation  sequence  (Ra)  .  It  can  save  time  in 
some  cases  and  uses  already  available  quantities  {G^}  ,  if  they  have 
been  coeluted  previously  for  plotting  or  observation  purposes. 


REAL  PROCESSES 


The  preceding  results  for  complex  multivariate  processes  can  be 
specialized  to  real  processes.  We  have,  from  equations  (171) *  and  (39), 


=  ,  % 


Therefore,  equation  (39)  becomes 


rca 


I. 


(45) 


N*/a 


wr(;  Wav)  s*  , 


(46) 


where 


,  V*0  or  Np/a 
I,  O-  k  «  N,/2  ) 

Now,  let  the  elements  of  matrices  and  Rg,  be  expressed  as 

£.-[<?’]  A’OT, 

(tt) 

Then,  G£  '  is  real  for  all  £;  and  from  equation  (46), 

Ny/z 


(47) 


(48) 


(49) 
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In  addition,  since 


*  (it) 

the  fundamental  range  of  a  is  [0,  Np/2]  for  sequence  (R^  }. 

REAL  BIVARIATE  PROCESSES 


(50) 


We  can  specialize  further  to  the  bivariate  case,  H  «  2,  and  make 
use  of  some  of  the  properties  previously  discussed.  (The  goal  of  these 
manipulations  will  not  be  clear  isitil  the  final  result.)  Define  the 
complex  scalar  sequence  {u^}  such  that 


(51) 


Then, 

N*-l 

JEL.  \  exp  i  2irk»  Jn^) 

K*  O 


* ^  [&r + 1  (*  • 


(52) 


If,  on  the  right-hand  side  of  equation  (52),  we  let  n  «  k  in  the 
first  sum,  and  n  ■  Np  -  k  in  the  second  sum,  we  get 


13 


+  i  5?*]  »*f  (t  i  »/A^) 

+  '  c&r  v ,  &r] «r(?iu/N,) 

NyA  N«, 

+  [s^  +  { j 

=  ^  .^L  ft,  [C  +  '  0 OS  (■br**/h£) 


t 


the  last  step  by  equation  (49);  that  is,  using  equation  (52)  again, 

=  FF\\u«t  •  (s4) 

Thus,  one  Nc>point  FFT  of  scalar  sequence  {u^},  defined  in  equation 
(51).  will  give  both  (aliased)  real  scalar  autocorrelations  (Rl11)}  and 
^  by  the  statement  under  equation  (50), {  )  need  be 

printed  out  only  for  0  <_  m  <_  Np/2. 


For  the  crosscorrelation,  equation  (46)  yields 


(55) 


K  ^  VnM-AOC 

=.^3— Re 


FFT, 


This  Np-point  FFT  of  ^  ♦  1  nonzero  numbers  would  yield 
and  from  equation  (39),  since 


NF-1 

0  ; 


ft 


-m 


Au 

R  (for  general  complex  M  *  M  matrices) , 

IB 


(56) 


it  follows  (using  the  periodicity  of{ft^j)  that  for  the  present  case 


Thus,  print  out  of  ljl2j  and  R^21)  for  0  <  m  <_  J-  suffices  to  give 
complete  information  about  the  aliased  crosscorrelation.  Furthermore, 
all  this  information  is  available  from  the  single  Np-point  FFT  of  equa¬ 
tion  (55) . 

In  summary,  only  the  two  FFTi  indicated  in  equations  (54)  and  (55) 
need  be  conducted  to  obtain  complete  information  about  the  aliased 
correlation  sequence  (ft,,),  for  M  ■  2.  These  relations,  in  addition  to 
the  exact  correlation  recursion  (11),  have  been  incorporated  in  the 
FORTRAN  program  listed  in  appendix  D.  The  comments  in  appendix  K  of 
the  earlier  report*  are  relevant  here  also. 


SIAMARY 


It  has  barn  shown  above  that,  for  the  weighting  introduced  in 
equation  (136), 1 

J7-,  *  0^',  ,  f ,  cUic.  2,  (5») 

Up  and  Vp  are  guaranteed  positive  definite,  and  the  correlation  recur¬ 
sion  (11)  is  stable.  Therefore,  equation  (58)  is  a  sufficient  condition 
for  the  desired  properties  to  hold  true.  It  is  not  known  whether  this  is 
a  necessary  condition,  that  is,  whether  equation  (S8)  is  the  only  choice 
that  results  in  the  desired  properties  of  positive  definiteness  and 
stability. 


However,  for  M  »  1,  since,  by  equation  (129), 1  UL  .  •  V-  . ,  it  is 
possible  to  show  that  p  1  F 


Ar-  ^  (n-i)  (s« 

is  the  only  choice  that  guarantees  the  desired  properties  (see  refer¬ 
ence  1,  page  32).  Nauely,  equations  (124), 1  (130), 1  and  (114)1  yi.id 
scalar 


“finr  Nm  f+l,  I. 


(60) 


In  addition,  if  the  data  saaples  happen  to  take  on  values  such  that* 


(61) 


then 


lAr'  *  +  fe)l  (M 


*lf  the  sample  nean  of  the  original  data  is  (aade)  zero,  this 
is  .not  possible  for  p  •  1.  For  p  >  1,  the  sanple  Beans  of  (Y^*1'} 


is  not  p< 


are  not  necessarily  zero. 


(62) 


choice 

and 
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which  is  always  larger  than  1  (unless  Kpml  •  r_  . ) ;  then^U-  is  negative 
and  an  unstable  correlation  recursion  results,  thus,  equation  (59)  is 
the  only  choice  that  guarantees  positive  lip  and  a  stable  correlation 
recursion,  regardless  of  the  data  set,  for  u  •  1. 

It  should  be  noticed  that  the  absolute  level  of  the  weights  is  not 
specified  by  aquation  (59).  Thus,  for  h  >  2,  freedon  in  equation  (SI), 
nt  least  to  the  extant  of  a  canon  scale  Tactor,  oust  he  allowed. 
Whether  this  is  the  only  degree  ef  frsslon  allowed  to  the  choice  of 

«d  r  j  is  unknown  for  N  »  2. 


17/11 
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Appendix  A 


SOtE  PROPERTIES  OF  COMPLEX  MATRICES 


(A-2) 


An  arbitrary  complex  square  matrix  A  is  called  real  definite  if 

V  •  r  (*•!)  ‘tv  any  %  (A‘15 

where  V  is  a  complex  column  matrix. 

It  then  follows  that 

A  real  definite #  A**  ■  A,  { >  real, 
where  {Xfc}  are  the  eigenvalues  of  A. 

For  proof,  first  take  the  conjugate  transpose  of  equation  (A-l) , 

VVty  •  r  tor  Any  If. 

Subtracting  equations  (A-l)  and  (A-S)  gives 

W-  A)V  •  o  Y 

Therefore, 

A11- A  •  0  ,  Or  A"  -  * 

Also,  if  (Vk)  are  the  eigenvectors  of  A,  then 

AWl, 

v;av,.\v;vl  . 

Since  the  left -heed  side  end  are  wal,  Xk  is  real. 

If  r  in  oqmntian  (A-l)  is  positive  for  any1*a,theo  A  is  said  to  be 
positive  definite.  It  follows  that 


(A- 3) 


(A-4) 


(A-S) 


(A-6) 


A  positive  definite#  A  >  A,  (X^)  >  0. 


(A-7) 


A-l 
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The  proof  is  the  sum  as  the  proof  above,  except  that  now  vj?AV.  >  0  in 
equation  (A-6) . 

Now,  we  are  in  position  to  prove  that 


A  pMitiv.  .tofll.it.  1  eigmvllut,  „f  A,  ..  , 

»  PMitiv.  (tofi.it.  J  »  *“ 

For  proof,  let  {X*}  and  {V^}  be  the  eigenvalues  and  eigenvectors  of  AB; 
then,  we  have 

*  V,V„ 

*  \  A'\ 

X,"bx*W\-\Wa(a-v,\ 

where  we  have  used  AH  ■  A  (equation  (A-7)).  Since  A  and  B  are 
definite,  the  left-hand  side  and  the  factor  multiplying  X.  are 
Therefore,  \y  is  positive. 


(A-9) 


positive 

positive. 


B 


then. 


AB 


«o>*+ 


r 


« 


(A- 10) 


It  should  be  noted  that  AB  need  not  be  Henitian  or  positive  defi¬ 
nite.  For  example,  if 

A  *  r  ^  "J  •»  rv«l, •<>  ®,  *<* 

ft  "‘"j  y.  «.i,  /> W, 


(A-U) 


Since  the  sain  diagonal  terns  of  AB  need  not  be  real,  AB  is  not 
necessarily  Hemitian.  Also,  if  we  assuae  that  AB  is  positive  definite, 
equation  (A-7)  says  that  AB  is  Henitian,  which  is  contradictory. 

A  nueeri cal  exaaple  follows: 


A-2 
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& 


-1 

2j 


B 


- 1  Tl . 


(A-12) 


A  and  B  are  positive  definite  and  Henitian.  The  eigenvalues  of  both 
are  {X^}  »  2  t^2  >  0.  Their  product  is 


AB 


p4-»2  4  ~ 

l*  «♦«]  9 


(A-13) 


with  eigenvalues  4  ±  2^1  >  0,  as  predicted.  But  AB  is  not  Henitian 
nor  positive  definite  because,  for  instance. 


r»  ab[;]  = 


4-»2. 


(A-14) 


The  Matrix  AB  in  equation  (A~13)  points  out  that  specifying  a 
■atrix  to  have  positive  eigenvalues  does  not  Make  that  Matrix  positive 
definite.  However,  if  the  Matrix  is  also  Henitian,  we  have  the  genera* 
li ration  of  equation  (A- 7)  to 


A  positive  definite  AH  ■  A,  (x^)  >  0. 


(A* IS) 


A-3/A-4 
Reverse  Blank 


w 
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Appendix  B 


RELATIONS  OP  DETERMINANTS 


|(P) 


Since  det  ■  1  (see  equation  (19)),  equation  (28)  yields 
<Jet  tff  *  det  det  ,  ,  *M  2  p- 


(B-l) 


Setting  ■  ■  p  in  equation  (B-l)  and  employing  equation  (17),  there  fol¬ 
lows 


det  tf?jf  *  det  Uf  d«t 


(B-2) 


Since  »  R0  »  U0  (see  equation  (9S)1),  this  recursion  nay  be 
written  in  closed  font  as 


det  (if  *  ft  \\  . 

f  k»o 


(B-3) 


This  relation  is  given  in  Burg, *  page  M. 


By  letting  ■  ■  p  ♦  1,  p  ♦  2,.  .  . ,  in  equation  (B-l),  it  follows 
iaaediately  that 


In  addition,  for  ■  <  p,  using  aquations  (17)  and  (B>3), 

MS?*  d*t<c*  Tf-wu,  »< r 

K-a 

Coabining  equations  (B-4)  and  (B-5) ,  wa  have 

i»  fijt  ^  ^  >  "*  r 

(ST  *  < 

v-  a»a 


(B-4) 


(B-5) 


(B-6) 


B-l/B-2 

Reverse  Blank 
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Appendix  C 

EXAMPLE  OF  UNSTABLE  CORRELATION  RECURSION 
Consider  the  univariate  (M  ■  1)  correlation  values* 


»  r^ ,  all  n,  r 


real  and  positive. 


(C-l) 


The  value  of  r  can  be  greater  or  less  than  unity.  The  z-transform  of 
equation  (C-l)  is 


Now. 


<■  * 
+  r 

fir 

iw»t 

n«-i 

r  ,T 

W>r, 

• 

IW 

|a|  <  -1— 

i»l  *  r 

(C-2) 


(C-3) 


But,  if  r  1,  there  is  no  cannon  region  of  convergence;  also, 
sequence  (RB)  is  unstable  if  r  >  1.  Nevertheless,  if  we  blithely  add 
terns  in  equation  (C-2),  we  get 


(C-4) 


Then,  continuing  on,  setting  z  ■  exp(i2*fA)  and  nultiplying  by  A, 

(C-5) 


c-i 


which  is  real,  and 


(C-6) 


In  the  following,  lit  r  f  1,  «  •  nin(r,^),  and  B  ■  nax(r,~) . 

w .» - 

This  is  s  stable  sequence  for  any  r.  But,  notice  that  if 

r<l t  c(*  r}  ^  •  ’r  f  Rh*  ftr  all 

whereas,  if 

r>l,  O  ^all  * 


Then, 

CC-7) 

(C-8) 


(C-9) 


The  forner  sequence  is  correct ;  the  latter  is  not.  Yet  both  are 
stable.  So,  although  equation  (C-6)  always  generates  a  stable  sequence, 
it  is  not  necessarily  the  original  sequence. 


Appendix  D 


FORTRAN  PROGRAM  FOR  SPECTRAL  ANALYSIS 


A  FORTRAN  listing  of  the  spectral  analysis  technique  is  given  in 
this  appendix,  in  addition  to  a  saaple  printout  of  an  application.  The 
'notation  and  scaling  adopted  is  identical  to  that  given  in  reference  1, 
appendix  K.  The  equation  nuabers  referenced  are  those  in  the  earlier 
report  except  in  Subroutine  ACM,  where  they  correspond  to  the  equa¬ 
tions  in  this  report. 
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PRINT  6'  <(R(I,J)»I=1,M)»J=1,M) 

PRINT  10 

FORMAT!/*  AKAIKE  INFORMATION  CRITERION! •/ 
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PRINT  U»  <P#AIC(P)  »PsOfPMAX) 
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ABSTRACT 


This  document  presents  both  the  oral  and  written  versions  of 
a  paper  presented  (in  15  minutes)  on  12  April  1978  at  the  1978 
IEEE  international  Conference  on  Acoustics,  Speech,  and 
Signal  Processing,  in  Tulsa,  Oklahoma. 

The  main  emphasis  of  the  talk  was  on  explaining  coherence 
and  its  usefulness.  The  paper  given  in  the  coherence  record 
emphasizes  how  to  estimate  coherence  and  how  accurately 
this  can  be  done.  In  underwater  acoustics  where  signals  are 
digitally  processed  at  the  outputs  of  two  or  more  receiving 
sensors,  it  is  desirable  to  estimate  the  coherence  spectrum, 
both  for  detection  and  position  estimation. 

A  processing  technique  for  computing  arbitrary  confidence 
bounds  for  stationary  Gaussian  signals  is  presented.  New 
computationally  difficult  examples  are  given  for  80-95  percent 
confidence  with  independent  averages  of  8,  16,  32,  64,  and 
128.  A  discussion  of  the  computational  difficulties  together 
with  algorithmic  details  (including  the  FORTRAN  program)  are 
presented. 


Approvoa  tor  public  r«MM,  attribution  unHmttbb. 
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CONFIDENCE  BOUNDS  FOR  MAGNITUDE-SQUARED 
COHERENCE  ESTIMATES 


*  Wh at  is  coherence? 

•  How  and  how  accurately 
do  you  estimate  it? 


The  purpose  of  this  talk  is  to  answer  two 

FUNDAMENTAL  QUESTIONS:  FIRST,  WHAT  IS  COHERENCE; 
SECOND,  HON  DO  YOU  ESTIMATE  COHERENCE  AND  HON 
ACCURATE  CAN  THIS  ESTIMATION  RE. 

The  main  emphasis  of  this  talk  is  the 

EXPLANATION  OP  COHERENCE  AND  ITS  USEFULNESS. 

The  paper  siven  in  the  conference  record  empha¬ 
sizes  HON  TO  ESTIMATE  COHERENCE  ANO  HON  ACCURATELY 
THIS  CAN  BE  DONE.  The  IMPORTANCE  OF  DCTERHININS 
CONFIDENCE  BOUNDS  FOR  ESTIMATES  OF  COHERENCE  NILL 
ONLY  BE  APPARENT  TO  SOMEONE  WHO  HANTS  TO  ESTIMATE 
COHERENCE.  THUS,  THE  TALK  THIS  HORN I NS  NILL  SHOW 
HON  USEFUL  THE  COHERENCE  IS  AMO  HON  TO  USE  THE 
RESULTS  IN  THE  COHERENCE  RECORD  TO  DETERMINE  THE 
ACCURACY  WITH  WHICH  THE  COHERENCE  CAN  BE 
ESTIMATED. 


NEXT  SLIDE  PLEASE- 


“•b<" 

[G#(0  Gb(f 

o  s  s  i. 

y  i 

a,b  cither  source,  receiver  pair 

or  receiver,  receiver  pair 

TmE  TERM  COHERENCE  HAS  SEVERAL  DIFFERENT 
MEANINGS  AND  DEFINITIONS.  The  ONE  WE  USE  HERE 
IS  THE  COMPLEX  COHERENCE  OR  COEFFICIENT  OF 
COHERENCT  defined  by  Weiner  in  1930,  For  our 


PURPOSES,  NC  DEFINE  THE  COHERENCE  BETWEEN  TWO 
STATIONARY  RANDOM  PROCESSES,  A  AMO  B,  AS  THE 
CROSS  POWER  SPECTRUM  DIVIDED  BY  THE  SQUARE  ROOT 
OF  THE  PROOUCT  OF  THE  AUTO  POWER  SPECTRA.  THE 
COHERENCE  IS  A  FUNCTION  OF  FREQUENCY  AND  HAS 
THE  USEFUL  PROPERTY  THAT  ITS  MAGNITUDE  SQUARED 
IS  BOUNDED  BETWEEN  ZENO  AND  UNITY.  IT  IS  A 
NORMALIZED  CROSS  SPECTRAL  DENSITY  THAT,  IN 
SOME  SENSE,  MEASURES  THE  EXTENT  TO  WHICH  TWO 
RAIBOM  PROCESSES  ARC  SIMILAR.  FOR  EXAMPLE. 

TWO  UNCORRCLATED  RANDOM  PROCESSES  ARE  INCOHERENT; 
THAT  IS,  THE  COHERENCE  IS  ZERO  BETWEEN  UNCORRE- 
LATED  PROCESSES.  FURTHER,  THE  COHERENCE  BETWEEN 
TWO  LINEARLY  RELATED  PROCESSES  IS  UNITY.  ThE 
TWO  PROCESSES  UNDER  CONSIDERATION  CAN  BE  AN 
UROERNATER  ACOUSTIC  SOURCE  AM  RECEIVER  PAIR 
OR  TWO  RECEIVER  PAIRS. 


-NEXT  SLIDE  PLEASE- 


ONE  PHYSICAL  PROBLEM  THAT  MOTIVATES  THIS 
RESEARCH  IS  THE  DESIRE  TO  PASSIVELY  ESTIMATE 
GEOGRAPHICAL  INFORMATION  ABOUT  THE  STATE  OF  AN 
ACOUSTIC  SOURCE.  In  THE  DEVELOPMENT  HERE,  AN 
ACOUSTIC  POINT  SOURCE  RADIATES  SPHERICAL  NAVES 
THAT  ARE  RECEIVED  FIRST  AT  ONE  SENSOR  AM  SOME 
DELAYED  TIME  LATER  AT  A  SECOM  SENSOR.  THE 
SOURCE  IS  ASSUMED  STATIONARY  FOR  THE  OBSERVATION 
PERIOD  AM  THE  SENSOR  SEPARATION  IS  ASSUMED 

known.  Each  received  waveform  is  observed  in 
THE  PRESENCE  OF  UNCORRELATED  NOISE.  The  PRO¬ 
BLEM  NE  ADDRESS  HERE  IS  THE  PHYSICAL  INTER¬ 
PRETATION  OF  THE  COHERENCE  FOR  THIS  MODEL. 

-NEXT  SLIDE  PLEASE- 
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A  SOURCE  SIGNAL  S  EXCITES  THE  MEDIUM  TO 
TISLD  AN  OUTPUT  Z.  THIS  OUTPUT  Z  IS  CORNUPTED 
BV  ADDITIVE  NOISE  It  AMO  RECEIVED  A ST.  Ik 
CONSTRUCT  A  LINEAR  MODEL  OP  THE  MEDIUM  THAT 
GENERATES  AN  OUTPUT  IR .  Bv  PROPER  CHOICE  OP 
THE  MOOCL  ME  CAN  MINIMIZE  THE  MEAN  SQUARE  ERROR 
C  OR  DIPPERENCE  SETMEEN  THE  RECEIVED  SIGNAL 
T  AMD  MODEL  OUTPUT  IN  .  ThE  MAGNITUDE  SQUARED 
COHERENCE  SETMEEN  SOURCE  AND  RECEIVER  IS  GIVEN 
BV  THE  RATIO  OP  THE  NOOEL  OUTPUT  POMER  TO  THE 
RECEIVER  OUTPUT  POMER.  SINCE  GAMMA  SQUARED  IS 
BOUNOSD  BV  UNITY,  IT  PROVIDES  AN  I W I CAT I ON  OP 
NNAT  PORTION  OP  THE  RECEIVED  POMER  CAN  BE 
ATTRIBUTED  TO  A  MINIMUM  MEAN  SQUARE  ERROR 
LINEAR  MODEL  OP  THE  OCEAN  MEDIUM.  ThE  POMER 
RATIO  OP  THE  OCEAN  OUTPUT  DUS  TO  THE  SOURCE 
VERSUS  AMBIENT  IS  ALSO  DIRECTLY  RELATED  TO  THE 
SOURCE-TO'RECEIVER  COHERENCE.  In  PARTICULAR, 
THIS  SIGNAL-TO-NOISE  RATIO  IS  GIVEN  BV  GAMMA 
SQUARED  OVER  ONE  MINUS  GAMMA  SQUARED. 

-NEXT  SLIDE  PLEASE - 


IN  THE  GENERAL  CASE,  ME  CAN  MODEL  THE 
ACOUSTIC  PROPAGATION  OF  A  SINGLE  ACOUSTIC  SOURCE 
AND  NOISE  CORRUPTED  RECEPTION  AT  TMO  RECEIVERS 
AS  SHORN  HERE.  In  PARTICULAR,  ME  TREAT  THE  PATH 
FROM  THE  SOURCE  TO  EACH  RECEIVER  AS  A  LINEAR 
TIME  INVARIANT  FILTER.  THE  RECEIVER  SIGNALS  r 
SUB  J  AND  r  SUB  K  CONSIST  OF  THE  FILTER  OUTPUTS 
PLUS  NOISE. 

A  SPECIAL  CASE  OF  THIS  MOOEL  IS  MHEN  THE 
FIRST  RECEIVER  MAVEFORM  CONSISTS  OF  SIGNAL  PLUS 
NOISE,  AND  THE  SECOND  RECEIVED  MAVEFORM  CONSISTS 
OP  AN  ATTENUATED  AND  DELAYED  SIGNAL  IN  THE 
PRESENCE  OF  UNCORRELATED  NOISE.  The  MATHEMATICAL 
PROBLEM  OF  ESTIMATING  THE  TIME  DELAY  OR  EQUIVALENT 
SOURCE  BEARIN6  AND,  THUS,  SOURCE  RANGE.  IS  CLOSELY 
RELATED  TO  COHERENCE'. 

Under  certain  assumptions  me  can  show  that 

THE  MAGNITUDE  SQUARED  COHERENCE  SETMEEN  TMO 
RECEIVER  PAIRS  IS  THE  PRODUCT  OF  THE  INDIVIDUAL 
SOURCE-TO-RECEIVER  COMBINATIONS.  Thus,  THE 
RECEIVED  SISNAL-TO-NOISE  RATIO  IS  THE  RECEIVER- 
TO- RECEIVER  MAGNITUDE  COHERENCE  OVER  ONE  MINUS 
THE  RECE I VER-TO-RECE I VER  MAGNITUDE  COHERENCE. 

-NEXT  SLIDE  PLEASE- 


Nom  that  coherence  has  seen  defined,  it  is 

APPROPRIATE  TO  DISCUSS  ITS  ESTIMATION.  FROM  EACH 
OF  TMO  FINITE  DURATION  MEMBER  FUNCTIONS  OF  CAPITAL 
N  SEGMENTS,  ME  HEIGHT  EACH  SEGMENT  BY  A  SMOOTH 
HEIGHT ING  FUNCTION,  COMPUTE  ITS  DISCRETE  FOURIER 
TRANSFORM  VIA  AN  FFT,  AND  DENOTE  THEM  A  SUB  n 
AND  B  SUB  n  .  At  any  particular  frequency,  the 
complex  coherence  is  estimated  SY  COMPUTING  the 
THREE  SUMMATIONS  SHOMN  OVER  THE  AVAILABLE  CAPITAL 
N  SEGMENTS.  ThE  LONER  CASE  R  DENOTES  THE  R -TM 
DATA  SEGMENT  AND  THE  FREQUENCY  INDICATOR  IS  NOT 
shonn.  In  the  numerator,  me  multiply  the  FFT  of 
THE  A  PROCESS  BY  THE  COMPLEX  CONJUGATE  OF  THE 
FFT  OF  THE  B  PROCESS  AND  SUM  OVER  N  SEGMENTS 
TO  OBTAIN  AN  ESTIMATE  OF  THE  COMPLEX  CROSS  SPEC¬ 
TRUM.  In  the  denominator  he  sum  the  magnitude 
SOUARED  FFTs  OVER  THE  f!  TIME  SEGMENTS.  UNDER 
CERTAIN  SIMPLIFYING  ASSUMPTIONS  GIVEN  IN  THE 
CONFERENCE  RECORD  HE  CAN  DETERMINE  The  STATISTICS 
OF  THIS  ESTIMATOR. 


-NEXT  SLIDE  PLTTSE- 
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•  DIFFICULT 
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In  tnc  commence  record  me  discuss  non  to 

OrmWINK  TNC  COMMERCE  BOUNDS.  FOR  A  PARTICULAR 
NIIHOCN  OP  FFT  AVWASIS  (E  ■  8)  AND  A  PRCSPCCIFICO 
COMIDCRCE  BOUND  (95X),  NC  OBTAIN  TNI  TNO  CUNVCS 
SKKTCNCD  NWC.  MhCN  MC  OBTAIN  AN  CSTIHATI  OP 
(ANNA  SQUARED  PROM  TNC  SANC  NIINBW  OP  FFTs  AC 
WCD  TO  ONAN  TNC  CUNVCS,  NC  USE  TNCSC  CUNVCS  TO 
DETERMINE  COMIDCNCC  BOMBS.  In  PARTICULAR,  IP 
NC  HAVE  AN  CSTINATC  DENOTED  BY  AN  X  ON  TNC 
ORDINATE,  NC  ORAM  A  HORIZONTAL  LINE  PROM  TNC  X 
UNTIL  IT  INTERSECTS  DOTH  CURVES.  TnCR  NC  DROP 
TNO  VERTICAL  LIMES  TO  TNC  ABSCISSA  AM  TNCSC  ARC 
TNC  CONFIDENCE  BOMBS.  MC  CAN  THEM  STATE  THAT 
TNC  TRUE  VALUE  OP  PAHHA  SQUARED  LIES  IN  TNC 
RESIOR  BOUMCD  BY  TNC  TNO  ABSCISSA  VALUES  WITH 
TNC  PRCSPSCIFICD  CONFIDENCE.  FOR  EXAMPLE,  WITH 
El  AMT  FFTs  AM  AN  ESTIMATE  OP  0.7,  TNC  95Z  CON¬ 
FIDENCE  BOMBS  ARE  0.3  AM  0.86.  WlTN  128  FFT  I 
AM  AN  ESTIMATE  OF  0.3,  THE  BOUNDS  ARE  0.2  AM 
0.38.  Thus,  the  sounds  are  lapse  even  when  the 
NUMBEN  OF  FFTs  IS  LAROE- 

-NEXT  SLIDE  PLEASE- 


In  CONCLUSION,  ME  HAVE  LOOKED  AT  WHAT  THE 
COHMCNCC  IS.  Me  HAVE  SEEN  THAT  IT  IS  A  NORMALIZED 
CROSS  SPECTRUM  THAT  CAN  PROVIDE  A  MEASURE  OF  SIONAL- 
TO-MISC  RATIO  AM  TNC  EXTENT  TO  WHICH  TNC  OCEAN 
MEDIUM  CAN  DC  HOOCLED  BY  A  LINEAR  FILTER.  In 
TCRNS  OP  HCASURIM  COHERENCE,  ME  HAVE  PRESENTED 
ESTIMATION  EOUATIONS  THAT  DEPEND  ON  THE  APPLICATION 
OP  SMOOTH  WCIBHTINS  FUNCTIONS  AM  LARNE  NUMBERS  OF. 

op  FFTs.  These  computational  difficulties  result 

IN  LAME  BOMBS  ON  TNC  COHERENCE  ESTIMATES. 

In  summary,  tnc  coherence  is  an  extrenely 
useful  descriptor  in  underwater  acoustics  that 

CAN  BE  ESTIMATED  WITH  CAREFUL  ATTENTION  TO  DETAIL 
AM  LAROE  NUMBERS  OF  FFTs. 

-SLIDE  OFF- 

ArE  THERE  ANY  QUESTIONS? 
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A88T8ACT 

Is  aadaraatar  asoostles  whore  sicaala 
are  dlsl tally  proessssd  at  tto  outputs 
•I  two  or  more  resolving  season,  It  la 
dnln»TI-f  to  sat  lasts  tea  coherence 
speotrum.  both  tar  detect loo  aad  position 
aatlastloa.  A  proeaaalac  technique  for 
eeapetlsg  arbitrary  confidence  bounds 
far  ststloasry  Oaasslaa  signals  la  pre¬ 
sented.  Mam  noapetat tonally  difficult 
eaaaples  are  glvee  for  80  to  989  conf id- 
aaso  with  ladepesdent  averages  of  I.  18. 
33,  84  aad  138.  A  discussion  of  ths 
eo^u  tat  tonal  difficulties  together  with 
algorlthale  details  an  presented. 


Vi.1< 


cabs reace  (M3C) 
two  Jointly  stationary  raadoa 
m  s(t)  aad  y(t)  la  defined  as 


Csy<f> 


iy«>ia 


(i) 


where  Ow.(f)  Is  ths  orooa-spaotral  deaslty 
at  frequency  f  aad  CmCf)  aad  Oyy(f)  an 
the  astospectral  daaaltles.  Ths  8SC  caa 
he  eat  lea ted  as  la  [1]  by 


(3) 


when  *  denotes  eoaplex  conjugate,  M  Is 
the  awbsr  of  data  segments  eoployed,  aad 
8|(f)  aad  TB(f )  an  the  Past  Pourler 
Traasforw  (PIT)  outputs  of  the  nth  data 
sepaants  of  x(t)  aad  y(t).  Both  the  83C 
aad  Its  estimates  are  bounded  by  taro  aad 
uslty.  The  euaaralatlve  distribution 
functions  (CDP)  for  the  M3C  estimate  In  (2) 
have  been  determined  In  f 1 ]  under  the 
assumptions  that  l)  the  data  are  jointly 
stationary  Gaussian  random  processes:  2) 
the  3  data  segments  are  Independent;  3) 
the  data  segments  have  been  multiplied  by 


a  smooth  weighting  function  to  reduce  side- 
lobe  leakage;  aad  4)  each  data  segment  la 
suff latently  loag  to  ensure  adequate  spec¬ 
tral  resolution. 

The  880.1a  useful  la  detection,  see 
for  example  t*]  aad  Cl]  .  but  Is  also  of 
value  la  estimating  the  amount  of  coherent 
power  common  between  two  received  signals. 
Therefore  It  would  bo  desirable  having 
estimated  a  particular  value  of  83C  to 
atats  nth  certain  confidence  that  the  trui 
coherence  falls  la  a  specified  Interval, 
larly  attempts  to  do  this  tor  99%  confid¬ 
ence  were  accomplished  by  Haubrleh  [4]  who 
apparently  used  precomputed  COP  curves  and 
used  a  different  method  of  presentation 
thaa  the  one  used  here.  Belated  confidence 
work  tor  ths  magnitude  coherence  (K)  or 
nquarsroot  of  (3)  Is  presented  by  Eoopmaas 
|S].  taplrleal  results  for  99%  confidence 
are  gives  by  Bealgaus  [6]. 

UClUmKTKO  COWPIDETCE  B00309 

Lat.C  be  ths  true  but  unknown  parame¬ 
ter  aad  C  be  Its  estimate.  Then  there 
exists  a  family  of  CDPs  such  as  the  two 
skatebed  la  Pig.  (1)  for  all  values  of  C 
aad  3.  Pot  a  fixed  value  of  8,  a  number  01 


C0XL0(l/3)  CaWS(l/3) 

PIG.  (1).  PLOT  OP  COP  CURVES  rOR 
5-8.  C-l/3.  A.NT)  X-8.  C-2/3 
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CDF  curves,,  such  ss  plotted  la  Fig.  (1), 
are  generated,  for  various  values  of  C. 

For  each  of  the  numerous  CDF  eurves,  we 
select,  as  closely  as  possible,  the 
abscissa  values  such  that  the  ordinate,  val¬ 
ues  FLS  sinus  FL7  yield  the  desired  col- 
fidence.  The  confidence  Intervals  are  not 
unique,  since  there  Is  no  constraint  such 
as  FLS  equal  FL7.  fe  have  selected  FL8 
equal  FL7  but  could  have  selected  FLS  and 
FL7  such'  that  the  difference  la  abscissa 
values  la  Fig.  (1)  CONUP(C)  sinus  CONLO(C) 
was  nlalsua.  Bowevsr,  as  long  as  FLS  sinus 
FL7  equals  the  desired  eonfldsscs  the 
sstbod  presented  here  Is  correct.  Mow  we 
plot  CONOP(C)  and  COMLO(C)  versus  C  for 
this  particular  value  of  H.  A  result  Is 
sketched  la  Fig.  (2). 


FZC.  (2).  HANDS FETCH  OF  CONFIDE NCI 
BOUNDS  FOR  A  PARTICULAR  VALUE  OF  M 


A  computer  program  has  been  written  to 
evaluate  the  CDF  and  confidence  Halts. 

The  mathematical  details  of  the  CDF  as  a 
finite  sub  of  F21  hypergecswtrle  functions, 
each  one  a  polynomial,  are  given  in  [21. 

For  large  values  of  M  and  C,  a  brute  force 
app^oapb  to  computing  the  CDF  results  in 
numeric  overflows,  attempts  to  avoid  this 
pTohtom  can  result  in  underflows  or  other 
Inaccuracies.  The  program  listed  in  the 
Appendix  avoids  these  difficulties,  It  also 
incorporates  CDF  values  when  C  equals  xero 
or  unity,  since  these  can  be  computed  In 
closed  form. 

Figures  (3a)  and  (3b)  are  computer 
generated  80%  and  95%  confidence  limits, 
respectively.  The  five  pairs  of  curves 
in  each  figure  are  for  N  *  8,  18,  32,  84, 


and  128  from  outer  to  inner,  respectively. 
Raving  made  an  estimate  with  a  particular 
value  of  N.  only  one  pair  of  curves  applies. 
An  excellent  discussion  of  the  types  of 
statements  that  can  be  made  with  confid¬ 
ence  bounds  is  given  by  Cramer  C7l. 

Suppose  we  obtain  an  estimated  USC  of  0.7 
from  S  •  8  disjoint  FFTs.  then  we  draw  a 
borlmontal  line  from  0.7  on  Fig.  (3b)  for 
95%  confidence  limits  and  see  where  it 
Intersects  the  pair  of  M  •  8  (outer)  curves 
This  occurs  at  (approximate  abscissa 
values)  0.3  and  0.88.  Thus  we  state  with 
99%  confidence  that  tbs  true  but  unknown 
parameter  C  falls  In  tbs  Interval  (0.3, 
0.86).  Mo  matter  what  the  true  value  of  C, 
we  have  a  9%  probability  of  giving  an 
Incorrect  statement.  That  Is,  If  we  make 
many  estimates  of  MSC  and  keep  applying 
tbs  rule  described  (whether  or  not  C  Is 
random  or  constant)  we  will  correctly  in¬ 
clude  tbs  true  value  of  C  in  the  interval 
that  we  specify  95%  of  the  time.  Some¬ 
times  the  method  of  applying  the  rule  is 
la  doubt  as  for  example  in  Fig.  (3b)  If 
the  estimate  comes  out  to  be  0.3  and  N  »  8 
then  a  horizontal  line  does  not  intersect  the 
upper  confluence  limit  curve  unless  we 
extrapolate  it  backwards.  Doing  this  means 
making  statements  like:  with  95%  confid¬ 
ence  the  true  HSC  is  in  the  region  (-0.1, 
0.62).  Since  we  know  aprlorl  that  the 
true  value  of  C  la  non-negative,  we  could 
jnst  as  easily  say  (but  with  no  more 
confidence)  that  with  95%  confidence  (for 
R  ■  8  and  C  -  0.3)  the  true  USC  falls  la 
tbs  region  (0.0,  0.82).  Moreover,  if  both 
intersections  result  in  negative  regions 
(am  for  example  when  C  “  0.001  and  S  •  8) 
we  may  have  to  make  statements  like  with 
80%  confidence  the  true  SSC  lies  In  (0.0, 
0.0).  However.  If  we  continue  to  apply  the 
rule  and  run  the  experimental  trials  we 
will  make  correction  statements  ”80%"  of 
tbs  time.  It  Is  interesting  to  note  that 
due  to  the  properties  of  the  estimate  and 
our  selection  of  FL7  and  FLS  that  larger 
values  of  N  do  not  always  result  In  the 
upper  confidence  bound  belnr  lower.  This 
also  occurs  is  SC  estimate  confidence 
limits  f5].  It  is  also  Interesting  to 
note  that  while  Increasing  II  is  desirable, 
the  confidence  bounds  for  N  -  128  are  still 
very  large.  For  example,  even  when  N  - 
128  if  C  *  0.3  the  95%  confidence  Intervals 
are  still  (0.2.  0.38)  and  the  80%  confid¬ 
ence  intervals  (0.R4,  0.38)  are  not  much 
better. 
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SUBJECT  MATTER  INDEX 


Bearing  Estimation: 

TD  SS07 

TR  5335  (pp  1-6,  71,  140-144) 

Bias  of  Magnitude-Squared  Coherence: 

TM  TC-193-71 

TM  TD113-19-71  (practical  example) 

TR  4343 

TR  4423  (insufficient  resolving  power) 

TR  5291  (approximation) 

TR  5335  (pp  158-176) 

Bias  of  Magnitude  Coherence: 

TM  TD  11 3-4  8- 72 

TR  5291  (approximation) 

Coherence:  TR  5335  (pp  12-13) 

Computer  Algorithm  (FORTRAN)  for 

•  Chirp  Z  Transform  and  Partitioned  and 
Modified  Chirp  Z  Transform:  TM  TC-5-73 

•  Confidence  Bounds:  TD  5881 

•  Multivariate  Linear  Predictive  Spectral  Analysis:  TR  5729 

•  Magnitude- Squared  Coherence:  TR  5335  (pp  193-214) 

•  Receiver  Operating  Characteristics  (BASK):  TR  5335  (p  183) 

•  Time  Delay  Estimation:  TR  5335  (pp  212-214) 

Cumulative  Distribution  Function  of  Magnitude-Squared  Coherence: 

TM  TC-193-71 
TR  4343 

TR  5335  (pp  156-158,  180-183) 

Cumulative  Distribution  Function’ of  Magnitude  Coherence: 

TM  TD113-48-72 


Digital  Computer  Algorithm  (see  Computer  Algorithm) 


Examples  of  Magnitude-Squared  Coherence: 

TM  TD113- 19-71 
to  4423 

TR  S33S  (p  221) 

Fast  Fourier  Transform: 

TM  TD113-19-71 
TR  4343 
TR  4423 
TM  TC-S-73 

Frequency  Resolution  Effect:  TR  4423 

Frequency  Resolution  Computer  Algorithm:  TM  TC-5-73 

Generating  Specified  Coherence:  TM  TC-187-71 

Maximum  Likelihood  Estimation  of  Time  Delay:  TR  S33S  (pp  50-85) 

Magnitude  Coherence:  TR  S33S  (pp  12-13) 

Magnitude-Squared  Coherence:  TR  5335  (pp  12-13) 

Mean  Square  Error: 

TM  TD113-48-72 

TR  5291  (see  also  Bias  and  Variance) 

Moments  of  the  Magnitude-Squared  Coherence  Estimate: 

TR  5335  (pp  156-158) 

Moving  Sources:  TR  5335  (pp  121-131) 

Multiple  Sensors:  TR  5335  (pp  131-134,  140-144) 

Multiple  Sources:  TR  5335  (pp  112-121) 

Multivariate  Linear  Predictive  Spectral  Analysis:  TR  5729 

Nonlinear  Systems: 

TR  5335  (pp  22-43) 

TM  TC1-2-74 
TD  5881 

Partitioned  Modified  Chirp  Z  Transform: 

TM  TC-5-73 


Passive  Bearing  Estimation: 

TD  5507 

TR  5335  (pp  1-6,  71,  140-144) 

Phase  Transform:  TR  5335  (pp  88,  94,  100-102) 

Positive  Definite  Spectral  Estimate:  TR  5729 
Power  Spectral  Density  Matrix:  TM  TC1-5-73 

Probability  Density  Function  of  Phase  Estimate  (see  also  Cumulative 
Distribution  Function):  TM  771112 

Sonar  (see  Passive  Bearing  Estimation) 

Smoothed  Coherence  Transform  (SCOT): 

TM  TC-159-72 

TR  5335  (pp  88,  94,  98-100) 

Specified  Coherence:  TM  TC-187-71 

Stable  Correlation  Recursion:  TR  5729 

Time  Delay  Estimation: 

TR  5335 
TD  5507 

Variance  of 

•  Bearing  Estimates: 

TR  5335  (pp  71-76) 

TD  5507 

•  Magnitude  Coherence  Estimates: 

TM  TD113-48-72 

TR  5291  (approximation) 

•  Magnitude -Squared  Coherence  Estimates: 

TM  TC- 193-71 

TM  TD1 13- 19-71  (examples) 

TR  4343 

TR  5291  (approximation) 

TR  5335  (pp  176-178) 

•  Phase  Estimates: 

TM  771112 

TR  5335  (approximation  p  109) 

•  Time  Delay  Estimates: 

TR  5335  (pp  72-76) 

TD  5507 

Weighting  Functions,  Effect  on  Magnitude-Squared  Coherence  Estimation 
TR  4423 
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